May 14 03:30:10.908939 np0000000741 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: we strongly recommend against using it for new projects.
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: If you are already using Eventlet, we recommend migrating to a different
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: framework.  For more detail see
May 14 03:30:11.204232 np0000000741 nova-compute[97948]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:30:11.204232 np0000000741 nova-compute[97948]:   import eventlet
May 14 03:30:12.605078 np0000000741 nova-compute[97948]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=97948) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 03:30:12.605473 np0000000741 nova-compute[97948]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=97948) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 03:30:12.605473 np0000000741 nova-compute[97948]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=97948) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 03:30:12.605654 np0000000741 nova-compute[97948]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 14 03:30:12.725324 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:30:12.735742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:30:12.783044 np0000000741 nova-compute[97948]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 14 03:30:13.636630 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 14 03:30:13.636987 np0000000741 nova-compute[97948]: INFO nova.utils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] The long task thread pool MainProcess.long_task is initialized
May 14 03:30:13.637031 np0000000741 nova-compute[97948]: INFO nova.virt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 14 03:30:13.747198 np0000000741 nova-compute[97948]: INFO nova.compute.provider_config [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 14 03:30:14.249285 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Acquiring lock "singleton_lock" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:30:14.249398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Acquired lock "singleton_lock" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:30:14.249567 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Releasing lock "singleton_lock" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:30:14.249753 np0000000741 nova-compute[97948]: WARNING oslo_service.backend._threading.service [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] no_fork=True: running service in main process
May 14 03:30:14.250013 np0000000741 nova-compute[97948]: INFO nova.service [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Starting compute node (version 33.1.0)
May 14 03:30:14.752669 np0000000741 nova-compute[97948]: INFO nova.utils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] The default thread pool MainProcess.default is initialized
May 14 03:30:14.753359 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:30:14.753593 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Starting event thread {{(pid=97948) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 14 03:30:14.753965 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Starting connection event dispatch thread {{(pid=97948) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 14 03:30:14.754560 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Connecting to libvirt: qemu:///system {{(pid=97948) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 14 03:30:15.285292 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x79d0c1756c60> {{(pid=97948) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 14 03:30:15.286377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x79d0c1756c60> {{(pid=97948) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 14 03:30:15.287552 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Connection event '1' reason 'None'
May 14 03:30:15.790057 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Cannot update service status on host "np0000000741" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000741 could not be found.
May 14 03:30:15.790301 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.mount [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Initialising _HostMountState generation 0 {{(pid=97948) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 14 03:30:25.526088 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host capabilities <capabilities>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:   <host>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     <uuid>f0c6eb37-7cce-44fb-9b97-77f3585cbbbb</uuid>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     <cpu>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <arch>x86_64</arch>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <model>EPYC-Milan</model>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <microcode version='16777317'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <signature family='25' model='1' stepping='1'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <maxphysaddr mode='emulate' bits='40'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='x2apic'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='tsc-deadline'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='osxsave'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='hypervisor'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='tsc_adjust'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='ospke'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='vaes'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='vpclmulqdq'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='spec-ctrl'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='stibp'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='arch-capabilities'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='ssbd'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='cmp_legacy'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='topoext'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='stibp-always-on'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='virt-ssbd'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='amd-psfd'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='lbrv'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='tsc-scale'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='vmcb-clean'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='flushbyasid'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='pause-filter'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='pfthreshold'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='v-vmsave-vmload'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='vgif'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='no-nested-data-bp'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='lfence-always-serializing'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='null-sel-clr-base'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='rdctl-no'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='skip-l1dfl-vmentry'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='mds-no'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='pschange-mc-no'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <feature name='gds-no'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <pages unit='KiB' size='4'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <pages unit='KiB' size='2048'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <pages unit='KiB' size='1048576'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     </cpu>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     <power_management/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     <iommu support='no'/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     <migration_features>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <live/>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       <uri_transports>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:         <uri_transport>tcp</uri_transport>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:         <uri_transport>rdma</uri_transport>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:       </uri_transports>
May 14 03:30:25.526088 np0000000741 nova-compute[97948]:     </migration_features>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:     <topology>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <cells num='1'>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:         <cell id='0'>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <memory unit='KiB'>24607192</memory>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <pages unit='KiB' size='4'>6151798</pages>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <pages unit='KiB' size='2048'>0</pages>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <pages unit='KiB' size='1048576'>0</pages>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <distances>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <sibling id='0' value='10'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           </distances>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           <cpus num='12'>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:           </cpus>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:         </cell>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       </cells>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:     </topology>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:     <cache>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 14 03:30:25.527768 np0000000741 nova-compute[97948]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     </cache>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <secmodel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <model>apparmor</model>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <doi>0</doi>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     </secmodel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <secmodel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <model>dac</model>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <doi>0</doi>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     </secmodel>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:   </host>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <arch name='alpha'>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>clipper</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:     <arch name='armv6l'>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>borzoi</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>spitz</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>nuri</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-b1</machine>
May 14 03:30:25.528484 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatileab</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>kzm</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-a</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>smdkc210</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>z2</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tosa</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>sabrelite</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-eb</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n810</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n800</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 03:30:25.529459 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatilepb</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>terrier</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mainstone</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>integratorcp</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>midway</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>musicpal</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>microbit</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='3'>fby35</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cubieboard</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>verdex</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>bpim2u</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduino2</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>raspi2b</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cheetah</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 03:30:25.530313 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>highbank</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>akita</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>connex</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>collie</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi0</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:     <arch name='armv7l'>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>borzoi</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>spitz</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>nuri</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-b1</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatileab</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>kzm</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-a</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 03:30:25.531094 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>smdkc210</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>z2</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tosa</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>sabrelite</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-eb</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n810</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n800</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatilepb</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>terrier</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mainstone</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>integratorcp</machine>
May 14 03:30:25.531926 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>midway</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>musicpal</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>microbit</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='3'>fby35</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cubieboard</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>verdex</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>bpim2u</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduino2</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>raspi2b</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cheetah</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>highbank</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>akita</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>connex</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>collie</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi0</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 03:30:25.532671 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:     <arch name='aarch64'>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>borzoi</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>spitz</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>nuri</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-b1</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatileab</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>kzm</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>musca-a</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>smdkc210</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 03:30:25.533372 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>z2</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>tosa</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>sabrelite</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-eb</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>sbsa-ref</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n810</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>n800</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>versatilepb</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>terrier</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mainstone</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>integratorcp</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 03:30:25.534392 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>midway</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>musicpal</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>microbit</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='3'>fby35</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>raspi3ap</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cubieboard</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>verdex</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>bpim2u</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduino2</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>raspi3b</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>raspi2b</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>cheetah</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>highbank</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>akita</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>connex</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>collie</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>raspi0</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <acpi default='on' toggle='yes'/>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.535335 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     <arch name='cris'>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>axis-dev88</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:     <arch name='i686'>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 14 03:30:25.536405 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>x-remote</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 14 03:30:25.537776 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>isapc</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 14 03:30:25.538771 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>microvm</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 14 03:30:25.539716 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <domain type='kvm'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <pae/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <nonpae/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <acpi default='on' toggle='yes'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <apic default='on' toggle='no'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <arch name='m68k'>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mcf5208evb</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-7.0</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>an5206</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-6.0</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>q800</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-8.1</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-7.2</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-6.2</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-8.0</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>next-cube</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-7.1</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-6.1</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virt-8.2</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <arch name='microblaze'>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:     <arch name='microblazeel'>
May 14 03:30:25.540480 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <arch name='mips'>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>malta</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mipssim</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <arch name='mipsel'>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>malta</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mipssim</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <arch name='mips64'>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>malta</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mipssim</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>pica61</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>magnum</machine>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:     <arch name='mips64el'>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 14 03:30:25.541554 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>malta</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>loongson3-virt</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mipssim</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>pica61</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>magnum</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='16'>boston</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>fuloong2e</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <arch name='ppc'>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g3beige</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>amigaone</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mac99</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ppce500</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sam460ex</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>pegasos2</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>bamboo</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>40p</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ref405ep</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:     <arch name='ppc64'>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-noble</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>amigaone</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv9</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 14 03:30:25.542611 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv10</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ppce500</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>40p</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>pegasos2</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>bamboo</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-focal</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g3beige</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-disco</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 14 03:30:25.543720 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mac99</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-impish</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-artful</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sam460ex</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ref405ep</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv8</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:     <arch name='ppc64le'>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-noble</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>amigaone</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv9</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv10</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ppce500</machine>
May 14 03:30:25.544445 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>40p</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>pegasos2</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>bamboo</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-focal</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>g3beige</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-disco</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>mac99</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-impish</machine>
May 14 03:30:25.545275 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-artful</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sam460ex</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>ref405ep</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='2048'>powernv8</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <arch name='riscv32'>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='8'>spike</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>opentitan</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='5'>sifive_u</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sifive_e</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <arch name='riscv64'>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='512'>virt</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='8'>spike</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='5'>sifive_u</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>shakti_c</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sifive_e</machine>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:     <arch name='s390x'>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 14 03:30:25.546070 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 14 03:30:25.547168 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <arch name='sh4'>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>shix</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>r2d</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <arch name='sh4eb'>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>shix</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>r2d</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:     <arch name='sparc'>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>SS-5</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>SS-20</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>LX</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>SPARCClassic</machine>
May 14 03:30:25.547724 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>leon3_generic</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>SPARCbook</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>SS-4</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>SS-600MP</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>SS-10</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>Voyager</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <arch name='sparc64'>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sun4u</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>niagara</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>sun4v</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:     <arch name='x86_64'>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <wordsize>64</wordsize>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 14 03:30:25.548667 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>x-remote</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 14 03:30:25.549541 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='1'>isapc</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 14 03:30:25.550189 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>microvm</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 14 03:30:25.550767 np0000000741 nova-compute[97948]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <domain type='kvm'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <acpi default='on' toggle='yes'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <apic default='on' toggle='no'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <arch name='xtensa'>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>sim</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>kc705</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ml605</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ml605-nommu</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>virt</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx60-nommu</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx200</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx200-nommu</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx60</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>kc705-nommu</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:   <guest>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <os_type>hvm</os_type>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:     <arch name='xtensaeb'>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <wordsize>32</wordsize>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='4'>sim</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>kc705</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ml605</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>ml605-nommu</machine>
May 14 03:30:25.551358 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>virt</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx60-nommu</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx200</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx200-nommu</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>lx60</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <machine maxCpus='32'>kc705-nommu</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <domain type='qemu'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     </arch>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <features>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <cpuselection/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <deviceboot/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <disksnapshot default='on' toggle='no'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <externalSnapshot/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     </features>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   </guest>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]: </capabilities>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]: 
May 14 03:30:25.552305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.552305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 14 03:30:25.552305 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-alpha</path>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <machine>clipper</machine>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <arch>alpha</arch>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <vcpu max='4'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.552305 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.553327 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.554594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.554594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 14 03:30:25.554594 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-arm</path>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <machine>virt-8.2</machine>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <arch>armv6l</arch>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.554594 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 03:30:25.555612 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.556290 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <gic supported='yes'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       <enum name='version'>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>2</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:         <value>3</value>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     </gic>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.557345 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.558950 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 14 03:30:25.558950 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-arm</path>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <machine>virt-8.2</machine>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <arch>armv6l</arch>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 03:30:25.558950 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.560116 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.560996 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <gic supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='version'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>2</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>3</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </gic>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.562227 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.562227 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 14 03:30:25.562227 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-arm</path>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <machine>virt-8.2</machine>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <arch>armv7l</arch>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.562227 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 03:30:25.563192 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.563932 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     <gic supported='yes'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       <enum name='version'>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>2</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:         <value>3</value>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.564947 np0000000741 nova-compute[97948]:     </gic>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.566215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.566215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 14 03:30:25.566215 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-aarch64</path>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <machine>virt-8.2</machine>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <arch>aarch64</arch>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 14 03:30:25.566215 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 14 03:30:25.567024 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.567528 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:     <gic supported='yes'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:       <enum name='version'>
May 14 03:30:25.568532 np0000000741 nova-compute[97948]:         <value>2</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>3</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     </gic>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.570396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.570396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 14 03:30:25.570396 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-cris</path>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <machine>axis-dev88</machine>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <arch>cris</arch>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.570396 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.571845 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.573755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.573755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 14 03:30:25.573755 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-i386</path>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <machine>pc-i440fx-noble</machine>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <arch>i686</arch>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <vcpu max='255'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.573755 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='lm'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 03:30:25.574725 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.575412 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.575970 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.577016 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.578248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 14 03:30:25.578248 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-i386</path>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <machine>pc-i440fx-noble-v2</machine>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <arch>i686</arch>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <vcpu max='255'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.578248 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='lm'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.579344 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.580019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.580493 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.581425 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.582825 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 14 03:30:25.582825 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-i386</path>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <machine>pc-q35-noble</machine>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <arch>i686</arch>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <vcpu max='1024'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.582825 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='lm'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.585138 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.586445 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.587040 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.588129 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.589489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 14 03:30:25.589489 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-i386</path>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <machine>pc-q35-noble-v2</machine>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <arch>i686</arch>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <vcpu max='1024'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.589489 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='lm'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.590998 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.591763 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.592285 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.593225 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.594390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.594390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 14 03:30:25.594390 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-m68k</path>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <machine>mcf5208evb</machine>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <arch>m68k</arch>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.594390 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.595600 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.597188 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 14 03:30:25.597188 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-m68k</path>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <machine>virt-8.2</machine>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <arch>m68k</arch>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.597188 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.599669 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.601761 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.601761 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 14 03:30:25.601761 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-microblaze</path>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <machine>petalogix-s3adsp1800</machine>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <arch>microblaze</arch>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.601761 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.603533 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.605667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.605667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 14 03:30:25.605667 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <machine>petalogix-s3adsp1800</machine>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <arch>microblazeel</arch>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.605667 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.607109 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.609346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.609346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 14 03:30:25.609346 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-mips</path>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <machine>malta</machine>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <arch>mips</arch>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <vcpu max='16'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.609346 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.610430 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.611694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.611694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 14 03:30:25.611694 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-mipsel</path>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <machine>malta</machine>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <arch>mipsel</arch>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <vcpu max='16'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.611694 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.612718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.613868 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.613868 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 14 03:30:25.613868 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-mips64</path>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <machine>malta</machine>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <arch>mips64</arch>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <vcpu max='16'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.613868 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.614909 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.616389 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.617351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.617351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 14 03:30:25.617351 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-mips64el</path>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <machine>malta</machine>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <arch>mips64el</arch>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <vcpu max='16'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.617351 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.618259 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.619400 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.619400 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 14 03:30:25.619400 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc</path>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <machine>g3beige</machine>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <arch>ppc</arch>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.619400 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.620749 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.621922 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.621922 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 14 03:30:25.621922 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <machine>pseries-noble</machine>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <arch>ppc64</arch>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <vcpu max='4096'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.621922 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.622971 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>tpm-spapr</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>spapr-tpm-proxy</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.624129 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.625211 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 14 03:30:25.625211 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <machine>powernv9</machine>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <arch>ppc64</arch>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <vcpu max='2048'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.625211 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>tpm-spapr</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>spapr-tpm-proxy</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.626275 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.627510 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 14 03:30:25.627510 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <machine>pseries-noble</machine>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <arch>ppc64</arch>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <vcpu max='4096'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.627510 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.628511 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>tpm-spapr</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>spapr-tpm-proxy</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.629778 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.629778 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 14 03:30:25.629778 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.629778 np0000000741 nova-compute[97948]:   <machine>powernv9</machine>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <arch>ppc64le</arch>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <vcpu max='2048'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.630849 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>tpm-spapr</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>spapr-tpm-proxy</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.631986 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.633209 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 14 03:30:25.633209 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <machine>pseries-noble</machine>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <arch>ppc64le</arch>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <vcpu max='4096'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.633209 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>tpm-spapr</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:         <value>spapr-tpm-proxy</value>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.634404 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.635907 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.635907 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 14 03:30:25.635907 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-riscv32</path>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <machine>virt</machine>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <arch>riscv32</arch>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.635907 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.636834 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.638063 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.639293 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.639293 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 14 03:30:25.639293 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-riscv64</path>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <machine>virt</machine>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <arch>riscv64</arch>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <vcpu max='512'/>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>any</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.639293 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.640203 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.641429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.641429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 14 03:30:25.641429 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-s390x</path>
May 14 03:30:25.641429 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <machine>s390-ccw-virtio-noble</machine>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <arch>s390x</arch>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <vcpu max='248'/>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.3</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.2</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.4</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z196</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z114-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen16b</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen16a</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.5</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z196.2</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zEC12</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9BC</model>
May 14 03:30:25.642459 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13.2</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14.2</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z196-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z800</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>max</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen15b</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen15a</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z114</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13s</model>
May 14 03:30:25.643355 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890.3</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890.2</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z890-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z10BC</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>zBC12</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z990-base</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.644311 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <s390-pv supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.645208 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.646604 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.646604 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 14 03:30:25.646604 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-sh4</path>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <machine>shix</machine>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <arch>sh4</arch>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.646604 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.648031 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.649230 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.649230 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 14 03:30:25.649230 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <machine>shix</machine>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <arch>sh4eb</arch>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.649230 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.650124 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.651238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.651238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 14 03:30:25.651238 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-sparc</path>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <machine>SS-5</machine>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <arch>sparc</arch>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.651238 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <redirdev supported='no'/>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.652210 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='model'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.653404 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.653404 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 14 03:30:25.653404 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-sparc64</path>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <machine>sun4u</machine>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <arch>sparc64</arch>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <vcpu max='1'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.653404 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.654341 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.655572 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.655572 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 14 03:30:25.655572 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <machine>pc-i440fx-noble</machine>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <arch>x86_64</arch>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <vcpu max='255'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 03:30:25.655572 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.656535 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.657400 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.658019 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.658839 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.660209 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 14 03:30:25.660209 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <machine>pc-i440fx-noble-v2</machine>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <arch>x86_64</arch>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <vcpu max='255'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.660209 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.661226 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.662021 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>ide</value>
May 14 03:30:25.662574 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.663248 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.664314 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 14 03:30:25.664314 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <machine>pc-q35-noble</machine>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <arch>x86_64</arch>
May 14 03:30:25.664314 np0000000741 nova-compute[97948]:   <vcpu max='1024'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.665453 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.666316 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.666967 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.667571 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.668892 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.669991 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 14 03:30:25.669991 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <machine>pc-q35-noble-v2</machine>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <arch>x86_64</arch>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <vcpu max='1024'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     <enum name='firmware'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <value>efi</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='yes'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <enum name='maximumMigratable'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>on</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:         <value>off</value>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='yes'>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <model fallback='forbid'>EPYC</model>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <vendor>AMD</vendor>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='acpi'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='ss'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='monitor'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='hypervisor'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='erms'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='mpx'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='pcommit'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='clwb'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='umip'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='pku'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='vaes'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='la57'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='rdpid'/>
May 14 03:30:25.669991 np0000000741 nova-compute[97948]:       <feature policy='require' name='pks'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrm'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='fzrm'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrs'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='fsrc'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnowext'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='3dnow'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='xsaveerptr'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='wbnoinvd'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='npt'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='vgif'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='require' name='svme-addr-chk'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='vme'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='xsavec'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='fxsr_opt'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='misalignsse'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='osvw'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='topoext'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <feature policy='disable' name='nrip-save'/>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:     <mode name='custom' supported='yes'>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 03:30:25.670888 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 03:30:25.671510 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <model usable='yes' vendor='unknown'>486</model>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </mode>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>vmvga</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>qxl</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>ramfb</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.672271 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <tpm supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>tpm-tis</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>tpm-crb</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>passthrough</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>emulator</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>external</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='backendVersion'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>1.2</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>2.0</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </tpm>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='yes'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <genid supported='yes'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:     <hyperv supported='yes'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:       <enum name='features'>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>relaxed</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>vapic</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>spinlocks</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>vpindex</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>runtime</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>synic</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>stimer</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>reset</value>
May 14 03:30:25.673493 np0000000741 nova-compute[97948]:         <value>vendor_id</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>frequencies</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>reenlightenment</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>tlbflush</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>ipi</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>avic</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     </hyperv>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.674765 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.674765 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 14 03:30:25.674765 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-xtensa</path>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <machine>sim</machine>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <arch>xtensa</arch>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <vcpu max='4'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.674765 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.675718 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.676868 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=97948) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 03:30:25.676868 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 14 03:30:25.676868 np0000000741 nova-compute[97948]: <domainCapabilities>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <domain>qemu</domain>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <machine>sim</machine>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <arch>xtensaeb</arch>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <vcpu max='4'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <iothreads supported='yes'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <os supported='yes'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <enum name='firmware'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <loader supported='yes'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>rom</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>pflash</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='readonly'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>yes</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       <enum name='secure'>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:         <value>no</value>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     </loader>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   </os>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   <cpu>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <mode name='host-passthrough' supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <mode name='maximum' supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <mode name='host-model' supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:     <mode name='custom' supported='no'/>
May 14 03:30:25.676868 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:   <memoryBacking supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <enum name='sourceType'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <value>file</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <value>anonymous</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <value>memfd</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:   </memoryBacking>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:   <devices>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <disk supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='diskDevice'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>disk</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>cdrom</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>floppy</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>lun</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>fdc</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>sata</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </disk>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <graphics supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>sdl</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>vnc</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>spice</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>egl-headless</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>dbus</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <video supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='modelType'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>vga</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>cirrus</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>none</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>bochs</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </video>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <hostdev supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='mode'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>subsystem</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='startupPolicy'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>default</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>mandatory</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>requisite</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>optional</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='subsysType'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>pci</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>scsi</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='capsType'/>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='pciBackend'/>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </hostdev>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <rng supported='yes'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio-transitional</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>virtio-non-transitional</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>random</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>egd</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     </rng>
May 14 03:30:25.677824 np0000000741 nova-compute[97948]:     <filesystem supported='yes'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='driverType'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>path</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>handle</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>virtiofs</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     </filesystem>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <tpm supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <redirdev supported='yes'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='bus'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>usb</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     </redirdev>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <channel supported='yes'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>pty</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>unix</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>spicevmc</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     </channel>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <crypto supported='yes'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='model'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>virtio</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='type'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>qemu</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       <enum name='backendModel'>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:         <value>builtin</value>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:       </enum>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     </crypto>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:   </devices>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:   <features>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <gic supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <vmcoreinfo supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <genid supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <backingStoreInput supported='yes'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <backup supported='yes'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <async-teardown supported='yes'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <sev supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:     <sgx supported='no'/>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:   </features>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]: </domainCapabilities>
May 14 03:30:25.679015 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 03:30:25.679015 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Checking secure boot support for host arch (x86_64) {{(pid=97948) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 03:30:25.679015 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Checking secure boot support for host arch (x86_64) {{(pid=97948) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 03:30:25.679015 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Checking secure boot support for host arch (x86_64) {{(pid=97948) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 03:30:25.679733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Checking secure boot support for host arch (x86_64) {{(pid=97948) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 03:30:25.679733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Checking secure boot support for host arch (x86_64) {{(pid=97948) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 03:30:25.679733 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Secure Boot support detected
May 14 03:30:26.133985 np0000000741 nova-compute[97948]: INFO nova.virt.node [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Generated node identity 2bd2dd56-bccc-4319-9878-49768bc97c10
May 14 03:30:26.134182 np0000000741 nova-compute[97948]: INFO nova.virt.node [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Wrote node identity 2bd2dd56-bccc-4319-9878-49768bc97c10 to /opt/stack/data/nova/compute_id
May 14 03:30:26.636307 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Compute nodes ['2bd2dd56-bccc-4319-9878-49768bc97c10'] for host np0000000741 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 14 03:30:27.639670 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 14 03:30:28.643914 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] No compute node record found for host np0000000741. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000741 could not be found.
May 14 03:30:28.644337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:30:28.644337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:30:28.644337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:30:28.644445 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:30:28.703620 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:30:28.703878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:30:28.718781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:30:28.719208 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=16689MB free_disk=75.22452163696289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:30:28.719382 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:30:28.719738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:30:29.224476 np0000000741 nova-compute[97948]: WARNING nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] No compute node record for np0000000741:2bd2dd56-bccc-4319-9878-49768bc97c10: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2bd2dd56-bccc-4319-9878-49768bc97c10 could not be found.
May 14 03:30:29.729580 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Compute node record created for np0000000741:np0000000741 with uuid: 2bd2dd56-bccc-4319-9878-49768bc97c10
May 14 03:30:31.236126 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:30:31.236731 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:30:28 up 22 min,  2 users,  load average: 2.50, 1.64, 0.81\n'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:30:31.692243 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] [req-ab5df8cb-79dd-4246-a096-c405a70a809f] Created resource provider record via placement API for resource provider with UUID 2bd2dd56-bccc-4319-9878-49768bc97c10 and name np0000000741.
May 14 03:30:31.741335 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 14 03:30:31.741335 np0000000741 nova-compute[97948]: ] {{(pid=97948) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 14 03:30:31.741537 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.host [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] kernel doesn't support AMD SEV
May 14 03:30:31.741682 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:30:31.741850 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:30:31.742102 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:30:31.746598 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Libvirt baseline CPU <cpu>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:   <arch>x86_64</arch>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:   <model>Nehalem</model>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:   <vendor>AMD</vendor>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:   <topology sockets="12" cores="1" threads="1"/>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:   <maxphysaddr mode="emulate" bits="40"/>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]: </cpu>
May 14 03:30:31.746598 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 14 03:30:32.307289 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Updated inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 14 03:30:32.307689 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Updating resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 generation from 0 to 1 during operation: update_inventory {{(pid=97948) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 14 03:30:32.307689 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:30:32.441165 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Updating resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 generation from 1 to 2 during operation: update_traits {{(pid=97948) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 14 03:30:32.948313 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:30:32.948465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.229s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:30:32.948721 np0000000741 nova-compute[97948]: DEBUG nova.service [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=97948) start /opt/stack/nova/nova/service.py:195}}
May 14 03:30:32.964481 np0000000741 nova-compute[97948]: DEBUG nova.service [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=97948) start /opt/stack/nova/nova/service.py:211}}
May 14 03:30:32.980232 np0000000741 nova-compute[97948]: DEBUG nova.service [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] Join ServiceGroup membership for this service compute {{(pid=97948) start /opt/stack/nova/nova/service.py:221}}
May 14 03:30:32.980372 np0000000741 nova-compute[97948]: DEBUG nova.servicegroup.drivers.db [None req-9acee24e-ef7c-4b02-990a-7d859fb63107 None None] DB_Driver: join new ServiceGroup member np0000000741 to the compute group, service = <Service: host=np0000000741, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=97948) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 14 03:30:38.483536 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:31:21.982256 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.982849 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.982849 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.983127 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.983514 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.983807 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:21.984704 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:22.487016 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:22.487284 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:31:22.487537 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:22.991238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:31:22.991750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:31:22.991750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:31:22.991750 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:31:22.999283 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:31:23.000333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:31:23.016175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:31:23.016719 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=16388MB free_disk=75.09187316894531GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:31:23.016916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:31:23.017222 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:31:24.077873 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:31:24.078528 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:31:23 up 23 min,  2 users,  load average: 1.83, 1.59, 0.85\n'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:31:24.123843 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:31:24.124134 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:31:24.627077 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:31:25.132661 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:31:25.133197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.116s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:31:25.133197 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:31:25.134304 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.79 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:32:15.928782 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929354 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929354 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929354 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929503 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929668 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929818 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.929997 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:15.930114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:32:15.930258 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:32:16.433393 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:16.433556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:16.433727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:16.433879 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:32:16.441559 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:32:16.442567 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:16.459340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:16.459766 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=16376MB free_disk=74.88958358764648GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:32:16.459991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:16.460264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:17.508520 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:32:17.508977 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:32:16 up 24 min,  2 users,  load average: 1.23, 1.47, 0.85\n'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:32:17.549666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:32:17.549948 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:32:18.052432 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:32:18.557768 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:32:18.558188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:18.558188 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:32:38.485930 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:32:51.417445 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:51.417917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:51.919965 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:32:52.485506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:52.486013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:52.489176 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:32:52.489391 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Claim successful on node np0000000741
May 14 03:32:53.634672 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:32:53.634672 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:32:54.137924 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:32:54.643430 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.158s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:54.646229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:32:55.151072 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:32:55.151291 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:32:55.152059 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:32:55.153198 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:32:55.656221 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:32:56.159586 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:32:56.890003 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '206dd5cfe91b429597edf3e3be05805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11009575893b46008850ca3ba381844f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:32:57.168794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:32:57.171204 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:32:57.171204 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Creating image(s)
May 14 03:32:57.171204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:57.171204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:57.171938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:57.175727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:57.175727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:57.492227 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:57.496464 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:57.496904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:57.577060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.part --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:57.577685 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] 6612e57f-dc02-432a-8f21-51e588d0e5b8 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:32:57.578402 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:32:57.578988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.part /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:57.719760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.part /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.converted" returned: 0 in 0.141s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:57.725495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:57.791257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282.converted --force-share --output=json" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:57.791682 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.619s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:57.792061 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:57.796836 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:57.797939 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx6i4m6tp/privsep.sock']
May 14 03:32:57.805608 np0000000741 sudo[109704]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx6i4m6tp/privsep.sock
May 14 03:32:57.806233 np0000000741 sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 03:32:58.063374 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:32:58.063911 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 03:32:58.408957 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 03:32:58.409126 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:32:58.409126 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:32:58.409207 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:32:58.409207 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:32:58.409272 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:32:58.409272 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:32:58.409354 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:32:58.409354 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 03:32:58.644661 np0000000741 sudo[109704]: pam_unix(sudo:session): session closed for user root
May 14 03:32:58.646009 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Spawned new privsep daemon via rootwrap
May 14 03:32:58.646882 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 14 03:32:58.646949 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 14 03:32:58.647016 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 14 03:32:58.647334 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109714
May 14 03:32:58.729324 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:58.794408 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:58.795698 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:58.796134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:58.796544 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:58.799765 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:32:58.799765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:58.871873 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:58.872359 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:58.898388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk 1073741824" returned: 0 in 0.026s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:58.899025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.103s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:32:58.899335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:58.965679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.066s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:58.966551 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:32:58.968787 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:32:59.049576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:32:59.049976 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Cannot resize image /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:32:59.050524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:32:59.050733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Ensure instance console log exists: /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:32:59.051021 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:32:59.051305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:32:59.051566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:00.312680 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Successfully created port: addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:01.433133 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Successfully updated port: addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:01.760789 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:01.760992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:01.937403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:01.937527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquired lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:01.937880 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:02.114806 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-changed-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:02.114942 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Refreshing instance network info cache due to event network-changed-addbb048-98d8-4138-aa85-41273c86da0c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:02.115093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] Acquiring lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:02.183683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:02.183860 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:02.263265 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:02.457607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:02.457991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:02.545578 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:02.686128 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:02.810319 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:02.820360 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:02.820634 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:02.824049 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:02.824212 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Claim successful on node np0000000741
May 14 03:33:02.959796 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:03.175948 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updating instance_info_cache with network_info: [{"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:03.254947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:03.507706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:03.677867 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Releasing lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:03.678156 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Instance network_info: |[{"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:03.678603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] Acquired lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:03.680606 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Start _get_guest_xml network_info=[{"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:03.681008 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Refreshing network info cache for port addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:03.688388 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:03.690066 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-986835989', uuid='17280e5e-874d-407f-9a58-710dd3633f6b'), owner=OwnerMeta(userid='206dd5cfe91b429597edf3e3be05805a', username='tempest-DeleteServersTestJSON-323938856-project-member', projectid='11009575893b46008850ca3ba381844f', projectname='tempest-DeleteServersTestJSON-323938856'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729583.6894495) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:03.691132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:03.691467 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:03.692263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:03.692551 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:03.694284 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:03.694801 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:03.695006 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:03.695139 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:03.695302 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:03.695447 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:03.695602 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:03.695861 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:03.696017 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:03.696920 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:03.697335 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:03.697618 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:03.713849 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:33:03.715310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:32:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-986835989',display_name='tempest-DeleteServersTestJSON-server-986835989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-deleteserverstestjson-server-986835989',id=1,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11009575893b46008850ca3ba381844f',ramdisk_id='',reservation_id='r-p8gmcjwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-323938856',owner_user_name='tempest-DeleteServersTestJSON-323938856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:32:56Z,user_data=None,user_id='206dd5cfe91b429597edf3e3be05805a',uuid=17280e5e-874d-407f-9a58-710dd3633f6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:03.715574 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converting VIF {"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:03.716246 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:03.718779 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lazy-loading 'pci_devices' on Instance uuid 17280e5e-874d-407f-9a58-710dd3633f6b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:04.096149 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:04.096391 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:04.183123 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:04.223468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <uuid>17280e5e-874d-407f-9a58-710dd3633f6b</uuid>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <name>instance-00000001</name>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:name>tempest-DeleteServersTestJSON-server-986835989</nova:name>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:03</nova:creationTime>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:user uuid="206dd5cfe91b429597edf3e3be05805a">tempest-DeleteServersTestJSON-323938856-project-member</nova:user>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:project uuid="11009575893b46008850ca3ba381844f">tempest-DeleteServersTestJSON-323938856</nova:project>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         <nova:port uuid="addbb048-98d8-4138-aa85-41273c86da0c">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="serial">17280e5e-874d-407f-9a58-710dd3633f6b</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="uuid">17280e5e-874d-407f-9a58-710dd3633f6b</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.config"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5b:0a:dc"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <target dev="tapaddbb048-98"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/console.log" append="off"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:04.223468 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:04.227808 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Preparing to wait for external event network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:04.227808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:04.227808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:04.227808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:04.228989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:32:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-986835989',display_name='tempest-DeleteServersTestJSON-server-986835989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-deleteserverstestjson-server-986835989',id=1,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11009575893b46008850ca3ba381844f',ramdisk_id='',reservation_id='r-p8gmcjwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-323938856',owner_user_name='tempest-DeleteServersTestJSON-323938856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:32:56Z,user_data=None,user_id='206dd5cfe91b429597edf3e3be05805a',uuid=17280e5e-874d-407f-9a58-710dd3633f6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:04.229184 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converting VIF {"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:04.230417 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:04.230785 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:04.275767 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Created schema index Interface.name {{(pid=97948) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 03:33:04.275928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Created schema index Port.name {{(pid=97948) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 03:33:04.275980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Created schema index Bridge.name {{(pid=97948) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 03:33:04.276585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:33:04.276872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [POLLOUT] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.276935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:33:04.277300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.283304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.321615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.324659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:04.324659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:04.324659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.324659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef196142-634e-5d8b-be29-24e32759bc62', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:04.324659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.324861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:04.325126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:04.326378 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpy0zognfe/privsep.sock']
May 14 03:33:04.336330 np0000000741 sudo[109932]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpy0zognfe/privsep.sock
May 14 03:33:04.337129 np0000000741 sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 03:33:04.599017 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:04.611256 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 03:33:04.611357 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:33:04.611418 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:33:04.611500 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:04.615164 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:33:04.617800 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:33:04.618009 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:33:04.618577 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:04.618774 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 03:33:04.619203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:04.619375 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:05.041799 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 03:33:05.108721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.288s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:05.109039 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:05.111154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.857s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:05.114444 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:05.118665 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Claim successful on node np0000000741
May 14 03:33:05.129057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:05.194562 np0000000741 sudo[109932]: pam_unix(sudo:session): session closed for user root
May 14 03:33:05.196110 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Spawned new privsep daemon via rootwrap
May 14 03:33:05.197013 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 14 03:33:05.197142 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 14 03:33:05.197242 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 14 03:33:05.197340 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109943
May 14 03:33:05.207965 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:05.460526 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:05.460785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaddbb048-98, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:05.461352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaddbb048-98, col_values=(('qos', UUID('0dcbb858-8951-4bd2-b2c8-74f9812b7178')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:05.463691 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaddbb048-98, col_values=(('external_ids', {'iface-id': 'addbb048-98d8-4138-aa85-41273c86da0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:0a:dc', 'vm-uuid': '17280e5e-874d-407f-9a58-710dd3633f6b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:05.465294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:05.466299 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:05.472247 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:05.473324 np0000000741 nova-compute[97948]: INFO os_vif [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98')
May 14 03:33:05.618444 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:05.618444 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:05.618984 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:05.618984 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:05.693745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:05.844832 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updated VIF entry in instance network info cache for port addbb048-98d8-4138-aa85-41273c86da0c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:33:05.845089 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updating instance_info_cache with network_info: [{"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:05.884544 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42ea6f631ead49f187123675fdf49dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47b3ce0f3324e16883e5d4f93f2c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:06.122332 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:06.346836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6c7eb86c-cc7d-4e57-a4ba-7a035bef183e req-e35c4169-345e-4508-85ac-e05659ff4fa5 service nova] Releasing lock "refresh_cache-17280e5e-874d-407f-9a58-710dd3633f6b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:06.412687 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:06.413155 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:06.629070 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Successfully created port: 5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:06.631394 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:06.665958 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:06.915776 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:06.989926 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:06.990070 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:06.990208 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No VIF found with MAC fa:16:3e:5b:0a:dc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:06.990653 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Using config drive
May 14 03:33:07.120927 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Successfully updated port: 5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:07.142848 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Booting with volume e027d315-5771-46c1-b135-f1d6ee609c95 at /dev/vda
May 14 03:33:07.187670 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-changed-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:07.188431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Refreshing instance network info cache due to event network-changed-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:07.188611 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] Acquiring lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:07.188768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] Acquired lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:07.188876 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Refreshing network info cache for port 5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:07.210217 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:07.210917 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprhlqdlpz/privsep.sock']
May 14 03:33:07.217937 np0000000741 sudo[109987]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprhlqdlpz/privsep.sock
May 14 03:33:07.218751 np0000000741 sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 03:33:07.424664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.313s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:07.426795 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:07.429621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.922s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:07.436908 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:07.436908 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Claim successful on node np0000000741
May 14 03:33:07.461528 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 03:33:07.461652 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:33:07.461771 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:33:07.461834 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:07.461924 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:33:07.461924 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:33:07.462036 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:33:07.462078 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:07.462129 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 03:33:07.497607 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:07.622983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:07.690776 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:07.796941 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 03:33:07.797146 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 03:33:07.797322 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 03:33:07.797482 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:07.797530 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 03:33:07.799740 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 03:33:07.799740 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 03:33:07.799740 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 03:33:07.799740 np0000000741 nova-compute[97948]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 03:33:07.857673 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:07.938984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:07.939168 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:07.939495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:07.939743 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:08.068174 np0000000741 sudo[109987]: pam_unix(sudo:session): session closed for user root
May 14 03:33:08.072673 np0000000741 nova-compute[97948]: INFO oslo.privsep.daemon [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Spawned new privsep daemon via rootwrap
May 14 03:33:08.088729 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f0aeede522c40ebb7a930cc705ced61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4668ce4dcf7f40578e28a10b4ef8fff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:08.140104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.143662 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Creating config drive at /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.config
May 14 03:33:08.147001 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0q11gssn {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:08.168218 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:08.175430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:33:08.175753 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.nvmeof [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 14 03:33:08.179668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0q11gssn" returned: 0 in 0.032s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:08.197111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:08.216351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:33:08.217021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:33:08.228176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:33:08.229314 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c'] 
May 14 03:33:08.229469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:33:08.229610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:33:08.229895 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] <== get_connector_properties: return (1019ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:08.230210 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Updating existing volume attachment record: 317d53df-415b-45c1-9a18-336f83718d68 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:33:08.455050 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:08.594372 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Successfully created port: 12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:08.652078 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.671240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-687eb924-dbfb-446b-b35d-2a4d8af3d8d0 req-405b2db5-d5d4-4be7-8c7c-09af73368189 service nova] Releasing lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:08.673629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquired lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:08.673629 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:08.677154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.679206 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.767683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.771578 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:08.880870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:08.880870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:08.921495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:08.921848 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:08.928557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:08.928873 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:08.961680 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:09.234667 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Successfully updated port: 12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:09.382212 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:09.430330 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:09.439996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:09.511602 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-changed-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:09.512054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Refreshing instance network info cache due to event network-changed-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:09.512256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] Acquiring lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:09.512357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] Acquired lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:09.512498 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Refreshing network info cache for port 12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:09.578879 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778729589.5785892, 17280e5e-874d-407f-9a58-710dd3633f6b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:09.579216 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] VM Started (Lifecycle Event)
May 14 03:33:09.737448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:09.757738 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:09.945863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.516s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:09.946664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.253s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:09.946796 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:09.954133 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:09.954354 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Claim successful on node np0000000741
May 14 03:33:09.969439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:09.973980 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:09.980545 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:09.982280 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:09.982723 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Creating image(s)
May 14 03:33:09.984348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:09.984519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:09.985166 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:09.986037 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:09.990812 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:09.994169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:10.017076 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:10.033071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:10.069883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.076s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:10.070290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:10.070871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:10.071247 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:10.074216 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:10.074462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:10.087813 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:10.091669 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729590.0911303, 17280e5e-874d-407f-9a58-710dd3633f6b => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:10.091781 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] VM Paused (Lifecycle Event)
May 14 03:33:10.098153 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:10.136580 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Updating instance_info_cache with network_info: [{"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:10.139106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:10.142489 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:10.177701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk 1073741824" returned: 0 in 0.037s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:10.179120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.108s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:10.179471 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:10.264906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:10.266083 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:33:10.266345 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:10.316324 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:10.346765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:10.347077 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Cannot resize image /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:33:10.347393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:33:10.347530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:10.347826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:10.348019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:10.348171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:10.417114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:10.418200 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:10.418400 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Creating image(s)
May 14 03:33:10.420661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:33:10.421822 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Ensure instance console log exists: /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:10.422040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:10.422191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:10.422305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:10.454871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:10.455195 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:10.455530 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:10.455753 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:10.466403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:10.541828 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd2c73a16b8240fe82731ffe8581c72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d8ae1101e445b1b2e501e52a2d3f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:10.598950 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:10.603199 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:10.640106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Releasing lock "refresh_cache-076a3e05-e920-470e-8cef-d7cc0bd1e580" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:10.641496 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance network_info: |[{"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:10.642427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Start _get_guest_xml network_info=[{"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '076a3e05-e920-470e-8cef-d7cc0bd1e580', 'attached_at': '', 'detached_at': '', 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'serial': 'e027d315-5771-46c1-b135-f1d6ee609c95'}, 'boot_index': 0, 'attachment_id': '317d53df-415b-45c1-9a18-336f83718d68', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:10.645867 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:10.647238 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='076a3e05-e920-470e-8cef-d7cc0bd1e580'), owner=OwnerMeta(userid='42ea6f631ead49f187123675fdf49dea', username='tempest-ImageDependencyTests-1227918501-project-member', projectid='e47b3ce0f3324e16883e5d4f93f2c764', projectname='tempest-ImageDependencyTests-1227918501'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729590.6468847) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:10.648791 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:10.649707 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:10.655658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:10.673192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:10.673434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:10.677051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connector [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Factory for ISCSI on None {{(pid=97948) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 14 03:33:10.677426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:10.677607 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:33:10.678006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:10.678308 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:10.678981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:10.680100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:33:10.693573 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:10.694021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:10.694380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:10.694613 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:10.694988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:10.695222 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:10.711275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:10.711275 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:10.711735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:10.711735 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:10.729823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95] added
May 14 03:33:10.729823 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:10.729823 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:10.729823 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:10.729823 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:10.729823 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:10.729823 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:10.730056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95] added
May 14 03:33:10.732665 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:10.732665 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:10.732665 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:10.820862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e383d4f7-524f-4ca5-adcf-e97f881ed6bf req-6191c805-198c-44db-90cc-0abe0086fd7d service nova] Releasing lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:10.821340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquired lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:10.821519 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:10.956826 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 14 03:33:11.053902 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Successfully created port: bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:11.105958 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:33:11.405280 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:11.414046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:11.414304 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:11.459798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:11.461343 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:11.465999 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:11.466878 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:11.478554 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:11.616259 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Successfully updated port: bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:11.629314 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:11.732168 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:11.733737 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:11.749317 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:11.749317 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:11.754681 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:11.754681 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:11.759574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:11.761257 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:11.771094 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:11.771094 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:11.771319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:11.771319 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:11.771376 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:33:11.771376 np0000000741 nova-compute[97948]: 
May 14 03:33:11.774186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-changed-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:11.774378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Refreshing instance network info cache due to event network-changed-bf614564-cbed-475f-a34c-341baa20235d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:11.776391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] Acquiring lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:11.776391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] Acquired lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:11.776391 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Refreshing network info cache for port bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:11.780225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:11.780225 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:11.780514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:11.780514 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:11.780630 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:33:11.780630 np0000000741 nova-compute[97948]: 
May 14 03:33:11.791242 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Updating instance_info_cache with network_info: [{"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:11.916972 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:12.118817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:12.277462 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:12.293493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Releasing lock "refresh_cache-1ed891f3-7c51-4d5a-a71c-b81a64339bb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:12.293750 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance network_info: |[{"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:12.295879 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Start _get_guest_xml network_info=[{"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:12.298750 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:12.299275 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-494980965', uuid='1ed891f3-7c51-4d5a-a71c-b81a64339bb2'), owner=OwnerMeta(userid='5f0aeede522c40ebb7a930cc705ced61', username='tempest-VolumesAdminNegativeTest-1946600030-project-member', projectid='4668ce4dcf7f40578e28a10b4ef8fff5', projectname='tempest-VolumesAdminNegativeTest-1946600030'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729592.2989836) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:12.300000 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:12.300298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:12.301081 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:12.301229 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:12.302223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:12.302274 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:12.302426 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:12.302483 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:12.302595 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:12.302692 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:12.302812 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:12.302943 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:12.303046 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:12.303159 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:12.303258 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:12.303361 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:12.313348 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494980965',display_name='tempest-VolumesAdminNegativeTest-server-494980965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesadminnegativetest-server-494980965',id=3,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4668ce4dcf7f40578e28a10b4ef8fff5',ramdisk_id='',reservation_id='r-n7bo5aig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1946600030',owner_user_name='tempest-VolumesAdminNegativeTest-1946600030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:09Z,user_data=None,user_id='5f0aeede522c40ebb7a930cc705ced61',uuid=1ed891f3-7c51-4d5a-a71c-b81a64339bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:12.313529 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converting VIF {"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:12.314250 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:12.314945 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:12.345587 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:12.423254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.477s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:12.423964 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:12.428582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.458s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:12.433686 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:12.434250 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Claim successful on node np0000000741
May 14 03:33:12.476695 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:12.479587 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:12.480091 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Creating image(s)
May 14 03:33:12.482492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:12.482492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:12.482492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:12.482492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:12.482492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:12.521788 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:12.804842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.50.100,3260]
May 14 03:33:12.804842 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.50.100,3260] successful.
May 14 03:33:12.804842 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:12.805630 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.40.100,3260]
May 14 03:33:12.805630 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.40.100,3260] successful.
May 14 03:33:12.805630 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:12.816326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:12.817814 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <uuid>1ed891f3-7c51-4d5a-a71c-b81a64339bb2</uuid>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <name>instance-00000003</name>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesAdminNegativeTest-server-494980965</nova:name>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:12</nova:creationTime>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:user uuid="5f0aeede522c40ebb7a930cc705ced61">tempest-VolumesAdminNegativeTest-1946600030-project-member</nova:user>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:project uuid="4668ce4dcf7f40578e28a10b4ef8fff5">tempest-VolumesAdminNegativeTest-1946600030</nova:project>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         <nova:port uuid="12a18d9f-ca42-47d7-9ba6-8b2ad74a7612">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="serial">1ed891f3-7c51-4d5a-a71c-b81a64339bb2</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="uuid">1ed891f3-7c51-4d5a-a71c-b81a64339bb2</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.config"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0f:19:e4"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <target dev="tap12a18d9f-ca"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/console.log" append="off"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:12.817814 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:12.820763 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Preparing to wait for external event network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:12.820763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:12.820763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:12.820763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:12.820763 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494980965',display_name='tempest-VolumesAdminNegativeTest-server-494980965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesadminnegativetest-server-494980965',id=3,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4668ce4dcf7f40578e28a10b4ef8fff5',ramdisk_id='',reservation_id='r-n7bo5aig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1946600030',owner_user_name='tempest-VolumesAdminNegativeTest-1946600030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:09Z,user_data=None,user_id='5f0aeede522c40ebb7a930cc705ced61',uuid=1ed891f3-7c51-4d5a-a71c-b81a64339bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:12.821141 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converting VIF {"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:12.821141 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:12.821141 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:12.821141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:12.821747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:12.822164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:12.822288 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:12.823383 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:12.823560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cafce62b-2cf2-525b-95d6-35e6a27c5787', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:12.826833 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:12.827054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:12.828844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.828844 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.828844 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:12.829015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.829015 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.829015 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:12.829282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.134s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:12.829430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:12.830213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:12.831881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:12.832022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12a18d9f-ca, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:12.832527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:12.832739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12a18d9f-ca, col_values=(('qos', UUID('488dbef2-c66e-452a-a62e-bb167df0a77f')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:12.832937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12a18d9f-ca, col_values=(('external_ids', {'iface-id': '12a18d9f-ca42-47d7-9ba6-8b2ad74a7612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:19:e4', 'vm-uuid': '1ed891f3-7c51-4d5a-a71c-b81a64339bb2'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:12.835992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:12.837145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.837145 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.837145 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:12.837278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.837278 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:12.837278 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:12.837496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:12.837574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:12.837985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:12.838129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:12.840872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:12.841897 np0000000741 nova-compute[97948]: INFO os_vif [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca')
May 14 03:33:12.865968 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:12.865968 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:12.869600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:12.869600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:12.933138 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:12.933928 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:12.934269 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:12.949094 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:13.024247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02a232cf-5485-48b7-bd23-31db25e66f5d req-a73589ca-a005-4f2f-9e4d-46bade4c78c5 service nova] Releasing lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:13.029691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquired lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:13.029691 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:13.048390 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9171624056948e9898538cd5b0e0f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83195f6b3c514bc5b4441b6ede42e72e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:13.110465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:13.110696 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:13.140174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:13.259950 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.262328 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.262614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.322804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.part --force-share --output=json" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.323111 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:33:13.323656 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:33:13.323941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.part /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.446794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.part /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.converted" returned: 0 in 0.122s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.453086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.453932 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:13.523589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9.converted --force-share --output=json" returned: 0 in 0.070s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.524192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.042s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:13.524612 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.527221 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.528377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.593573 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Successfully created port: e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:13.607862 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:13.610000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json" returned: 0 in 0.081s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.612357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:13.612357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:13.612357 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.615785 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:13.616358 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:33:13.621438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.692301 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json" returned: 0 in 0.070s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.693076 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9,backing_fmt=raw /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.715341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:33:13.728247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9,backing_fmt=raw /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk 1073741824" returned: 0 in 0.034s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.728247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "82edef0dfcd3d203ccd443aac41481ae638e17d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:13.728247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.795238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82edef0dfcd3d203ccd443aac41481ae638e17d9 --force-share --output=json" returned: 0 in 0.067s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.795607 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:33:13.795864 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:13.876391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:13.877085 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Cannot resize image /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:33:13.877747 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:33:13.877972 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Ensure instance console log exists: /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:13.879267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:13.879619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:13.879753 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:13.893878 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:13.968948 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:14.030124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:14.030408 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:14.077202 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating instance_info_cache with network_info: [{"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:14.173387 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Successfully updated port: e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:14.183273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:14.284455 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:14.284773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:14.284928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:14.285062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:14.285186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] No waiting events found dispatching network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:14.285320 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0dbee30e-b991-4686-966b-38521adb829b req-c7caa1f8-6e4b-4566-a3ec-1a83137d72d2 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received unexpected event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 for instance with vm_state building and task_state spawning.
May 14 03:33:14.288974 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-changed-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:14.289439 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Refreshing instance network info cache due to event network-changed-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:14.289687 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] Acquiring lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:14.289840 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] Acquired lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:14.290118 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Refreshing network info cache for port e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:14.367123 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:14.367232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:14.367361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] No VIF found with MAC fa:16:3e:0f:19:e4, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:14.367816 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Using config drive
May 14 03:33:14.533464 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:14.579879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Releasing lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:14.579879 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance network_info: |[{"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:14.581507 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Start _get_guest_xml network_info=[{"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:32:48Z,direct_url=<?>,disk_format='qcow2',id=ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66,min_disk=0,min_ram=0,name='',owner='af9ef6b2ee064ee1b49e7db6e8eab1ab',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:32:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': 'ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:14.583333 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:14.584691 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-443284770', uuid='ed521445-93a9-42d1-bd32-da5d03ecfe95'), owner=OwnerMeta(userid='bd2c73a16b8240fe82731ffe8581c72e', username='tempest-AttachSCSIVolumeTestJSON-1194742276-project-member', projectid='20d8ae1101e445b1b2e501e52a2d3f90', projectname='tempest-AttachSCSIVolumeTestJSON-1194742276'), image=ImageMeta(id='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729594.5843117) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:14.585495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:14.585888 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:14.586527 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:14.586713 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:14.587585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:14.587906 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:32:48Z,direct_url=<?>,disk_format='qcow2',id=ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66,min_disk=0,min_ram=0,name='',owner='af9ef6b2ee064ee1b49e7db6e8eab1ab',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:32:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:14.588048 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:14.588255 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:14.588255 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:14.588336 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:14.588438 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:14.588592 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:14.588735 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:14.588840 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:14.588994 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:14.589780 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:14.600924 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-443284770',display_name='tempest-AttachSCSIVolumeTestJSON-server-443284770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachscsivolumetestjson-server-443284770',id=4,image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxNXrpuc3mlukgcNwB7toJEahEfe3v6AaW8QvG4Kgd+8vOFbNOgAa5xPNZyClsSwy4Om8Zs8Wu3l41w04FR56OqKjzHx3iLsP8zppgH/9SnwRIrIt0U6S9T/JYJjOcLkg==',key_name='tempest-keypair-1760705408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20d8ae1101e445b1b2e501e52a2d3f90',ramdisk_id='',reservation_id='r-vlfntqpo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1194742276',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1194742276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd2c73a16b8240fe82731ffe8581c72e',uuid=ed521445-93a9-42d1-bd32-da5d03ecfe95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:14.601169 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converting VIF {"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:14.601957 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:14.602700 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lazy-loading 'pci_devices' on Instance uuid ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:14.675206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:14.729347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Found WWN 33000000092b54080 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:33:14.729681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.051s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:14.729876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] <== connect_volume: return (4051ms) {'type': 'block', 'scsi_wwn': '33000000092b54080', 'path': '/dev/dm-0', 'multipath_id': '33000000092b54080'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:14.730040 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000092b54080', 'path': '/dev/dm-0', 'multipath_id': '33000000092b54080'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:33:14.792982 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:14.853662 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:14.872655 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:14.983792 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:14.985673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:14.986720 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:14.987187 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Creating image(s)
May 14 03:33:14.987620 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:14.987807 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:14.988472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:14.988888 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:14.992788 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:14.994139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.016990 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Creating config drive at /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.config
May 14 03:33:15.020766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpacqhoj4_ {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.043484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.617s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:15.044309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.011s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:15.045275 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:15.051085 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:15.051207 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Claim successful on node np0000000741
May 14 03:33:15.054218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpacqhoj4_" returned: 0 in 0.033s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.070954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.072604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:15.073047 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:15.073481 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:15.075788 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:15.076110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.106587 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <uuid>ed521445-93a9-42d1-bd32-da5d03ecfe95</uuid>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <name>instance-00000004</name>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-443284770</nova:name>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:14</nova:creationTime>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:image uuid="ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:user uuid="bd2c73a16b8240fe82731ffe8581c72e">tempest-AttachSCSIVolumeTestJSON-1194742276-project-member</nova:user>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:project uuid="20d8ae1101e445b1b2e501e52a2d3f90">tempest-AttachSCSIVolumeTestJSON-1194742276</nova:project>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         <nova:port uuid="bf614564-cbed-475f-a34c-341baa20235d">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="serial">ed521445-93a9-42d1-bd32-da5d03ecfe95</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="uuid">ed521445-93a9-42d1-bd32-da5d03ecfe95</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <target dev="sda" bus="scsi"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <address type="drive" controller="0" unit="0"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.config"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <target dev="sdb" bus="scsi"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <address type="drive" controller="0" unit="1"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:86:fd:94"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <target dev="tapbf614564-cb"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/console.log" append="off"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:15.106587 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:15.108748 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Preparing to wait for external event network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:15.108748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:15.108748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:15.108748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:15.109306 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-443284770',display_name='tempest-AttachSCSIVolumeTestJSON-server-443284770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachscsivolumetestjson-server-443284770',id=4,image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxNXrpuc3mlukgcNwB7toJEahEfe3v6AaW8QvG4Kgd+8vOFbNOgAa5xPNZyClsSwy4Om8Zs8Wu3l41w04FR56OqKjzHx3iLsP8zppgH/9SnwRIrIt0U6S9T/JYJjOcLkg==',key_name='tempest-keypair-1760705408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20d8ae1101e445b1b2e501e52a2d3f90',ramdisk_id='',reservation_id='r-vlfntqpo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1194742276',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1194742276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd2c73a16b8240fe82731ffe8581c72e',uuid=ed521445-93a9-42d1-bd32-da5d03ecfe95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:15.109475 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converting VIF {"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:15.110422 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:15.110741 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:15.111231 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.111592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.111994 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:15.112775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.112967 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01ad3d73-1e96-597a-9ccf-b3e077a0f1d3', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.113793 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.114619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:15.119726 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.122524 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.122769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf614564-cb, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.123157 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf614564-cb, col_values=(('qos', UUID('9f1b5cd2-67f1-47a2-94a6-17dde02cfbe1')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.123476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf614564-cb, col_values=(('external_ids', {'iface-id': 'bf614564-cbed-475f-a34c-341baa20235d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:fd:94', 'vm-uuid': 'ed521445-93a9-42d1-bd32-da5d03ecfe95'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.125558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:15.135438 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.136165 np0000000741 nova-compute[97948]: INFO os_vif [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb')
May 14 03:33:15.145501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.069s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.146716 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.175544 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk 1073741824" returned: 0 in 0.029s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.176070 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.103s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:15.176771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.235094 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='instance-depend-image',id=2,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e47b3ce0f3324e16883e5d4f93f2c764',ramdisk_id='',reservation_id='r-iqemyd1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1227918501',owner_user_name='tempest-ImageDependencyTests-1227918501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:07Z,user_data=None,user_id='42ea6f631ead49f187123675fdf49dea',uuid=076a3e05-e920-470e-8cef-d7cc0bd1e580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:15.235296 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converting VIF {"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:15.235896 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:15.236715 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lazy-loading 'pci_devices' on Instance uuid 076a3e05-e920-470e-8cef-d7cc0bd1e580 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:15.240668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.240998 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:33:15.241229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:15.302120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:15.302564 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Cannot resize image /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:33:15.303031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:33:15.303274 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Ensure instance console log exists: /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:15.303586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:15.304133 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:15.304133 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:15.477583 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.487650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cc1bb58-7157-42a8-a72b-ccbcc076e551 req-34db1553-df7b-4323-b19e-35f42a58d132 service nova] Releasing lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:15.488224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquired lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:15.488416 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:15.502014 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.503929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.552991 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:15.553112 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:15.553489 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:15.554715 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:15.608951 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.675658 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '268a04e0eb684905bd884ec47edd208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10298a13b54449ba0a0421dd9982254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:15.739960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <uuid>076a3e05-e920-470e-8cef-d7cc0bd1e580</uuid>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <name>instance-00000002</name>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:name>instance-depend-image</nova:name>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:10</nova:creationTime>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:user uuid="42ea6f631ead49f187123675fdf49dea">tempest-ImageDependencyTests-1227918501-project-member</nova:user>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:project uuid="e47b3ce0f3324e16883e5d4f93f2c764">tempest-ImageDependencyTests-1227918501</nova:project>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         <nova:port uuid="5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="192.168.233.225" ipVersion="4"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="serial">076a3e05-e920-470e-8cef-d7cc0bd1e580</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="uuid">076a3e05-e920-470e-8cef-d7cc0bd1e580</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/disk.config"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <alias name="ua-e027d315-5771-46c1-b135-f1d6ee609c95"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <serial>e027d315-5771-46c1-b135-f1d6ee609c95</serial>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:66:28:af"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <target dev="tap5ec267a3-57"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/console.log" append="off"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:15.739960 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:15.742073 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Preparing to wait for external event network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:15.742073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:15.742073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:15.742073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:15.742073 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='instance-depend-image',id=2,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e47b3ce0f3324e16883e5d4f93f2c764',ramdisk_id='',reservation_id='r-iqemyd1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1227918501',owner_user_name='tempest-ImageDependencyTests-1227918501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:07Z,user_data=None,user_id='42ea6f631ead49f187123675fdf49dea',uuid=076a3e05-e920-470e-8cef-d7cc0bd1e580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:15.742246 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converting VIF {"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:15.742246 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:15.742246 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:15.742362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.742652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.742922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:15.744599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.744599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8702c44-1978-5a34-a54b-62af628a8ec3', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.745037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.745915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:15.753407 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.756250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.756250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ec267a3-57, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.756250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ec267a3-57, col_values=(('qos', UUID('29ad7033-cead-4ba3-bc2f-aa78dd0cd104')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.756516 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ec267a3-57, col_values=(('external_ids', {'iface-id': '5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:28:af', 'vm-uuid': '076a3e05-e920-470e-8cef-d7cc0bd1e580'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:15.757258 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.759662 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:15.768170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.769305 np0000000741 nova-compute[97948]: INFO os_vif [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57')
May 14 03:33:15.781716 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.784025 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.808145 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:15.817070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:16.056960 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:16.068121 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:16.232342 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:16.258056 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729596.2576628, 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:16.258307 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] VM Started (Lifecycle Event)
May 14 03:33:16.372196 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:16.372417 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:16.372603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:16.372749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:16.372915 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] No event matching network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 in dict_keys([('network-vif-plugged', '12a18d9f-ca42-47d7-9ba6-8b2ad74a7612')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:16.373072 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received unexpected event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 for instance with vm_state building and task_state spawning.
May 14 03:33:16.373219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:16.373355 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:16.373527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:16.373669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:16.373817 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Processing event network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:16.373984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:16.374128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:16.374267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:16.374385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:16.374627 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] No waiting events found dispatching network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:16.374981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:16.375544 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e155679c-d0ad-4d68-a641-0213d406bbc4 req-0e2518a2-b2ee-4282-8c57-693e3744838b service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received unexpected event network-vif-plugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 for instance with vm_state building and task_state spawning.
May 14 03:33:16.377875 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:16.381491 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:16.381949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:16.382338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:16.382504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:16.382705 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] No event matching network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c in dict_keys([('network-vif-plugged', 'addbb048-98d8-4138-aa85-41273c86da0c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:16.383190 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9fa31203-cff8-4895-9778-305bad4ca528 req-5e20a04e-0bf6-409e-b8ca-1517ac6fa814 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received unexpected event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c for instance with vm_state building and task_state spawning.
May 14 03:33:16.384348 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance spawned successfully.
May 14 03:33:16.384674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:16.402684 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating instance_info_cache with network_info: [{"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:16.467802 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Successfully created port: c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:16.530488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:16.530760 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:16.571503 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:16.654425 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No BDM found with device name sda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:16.654533 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:16.654808 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No VIF found with MAC fa:16:3e:86:fd:94, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:16.655069 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Using config drive
May 14 03:33:16.762784 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:16.766665 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:16.889436 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.889583 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.889878 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.890105 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.890331 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.890559 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:16.904473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Releasing lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:16.904743 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance network_info: |[{"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:16.907466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Start _get_guest_xml network_info=[{"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:16.910783 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:16.912358 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-266585382', uuid='f444aa34-be20-4e14-acd9-19c487ab903f'), owner=OwnerMeta(userid='c9171624056948e9898538cd5b0e0f9b', username='tempest-VolumesAssistedSnapshotsTest-157421557-project-member', projectid='83195f6b3c514bc5b4441b6ede42e72e', projectname='tempest-VolumesAssistedSnapshotsTest-157421557'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729596.912025) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:16.913365 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:16.913728 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:16.914366 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:16.914517 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:16.915396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:16.915680 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:16.915809 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:16.915911 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:16.916025 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:16.916151 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:16.916187 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:16.916370 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:16.916482 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:16.918227 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:16.918345 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:16.918476 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:16.931512 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-266585382',display_name='tempest-VolumesAssistedSnapshotsTest-server-266585382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesassistedsnapshotstest-server-266585382',id=5,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvP4Qn2q7ltKLHrI6Q/OwekbecQ4F6ipIQSptt49HOaSkjD/NNG3s4UIy2AQ/QziHt1yhIE/LIRq5YEuRbH6I9SCBHHVjaHboHn5EU/s3UpHaULWDWaVZ+XRuTDMDNEsw==',key_name='tempest-keypair-251811921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83195f6b3c514bc5b4441b6ede42e72e',ramdisk_id='',reservation_id='r-v44vw9ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-157421557',owner_user_name='tempest-VolumesAssistedSnapshotsTest-157421557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9171624056948e9898538cd5b0e0f9b',uuid=f444aa34-be20-4e14-acd9-19c487ab903f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:16.931830 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converting VIF {"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:16.932462 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:16.933124 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lazy-loading 'pci_devices' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:16.992304 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Successfully updated port: c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:17.033498 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:17.162871 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:17.269265 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:33:17.269731 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729597.2693183, 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:17.269731 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] VM Paused (Lifecycle Event)
May 14 03:33:17.285218 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:17.285297 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:17.285419 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] No VIF found with MAC fa:16:3e:66:28:af, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:17.285890 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Using config drive
May 14 03:33:17.317054 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Creating config drive at /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.config
May 14 03:33:17.322217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphdpzpmit {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.362265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphdpzpmit" returned: 0 in 0.040s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.396754 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Took 7.42 seconds to spawn the instance on the hypervisor.
May 14 03:33:17.397173 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:17.436406 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <uuid>f444aa34-be20-4e14-acd9-19c487ab903f</uuid>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <name>instance-00000005</name>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-266585382</nova:name>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:16</nova:creationTime>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:user uuid="c9171624056948e9898538cd5b0e0f9b">tempest-VolumesAssistedSnapshotsTest-157421557-project-member</nova:user>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:project uuid="83195f6b3c514bc5b4441b6ede42e72e">tempest-VolumesAssistedSnapshotsTest-157421557</nova:project>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         <nova:port uuid="e571c1f8-0f1f-4c5d-9b08-4fe2020002cb">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="serial">f444aa34-be20-4e14-acd9-19c487ab903f</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="uuid">f444aa34-be20-4e14-acd9-19c487ab903f</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.config"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:73:88:9e"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <target dev="tape571c1f8-0f"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/console.log" append="off"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:17.436406 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:17.438907 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Preparing to wait for external event network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:17.438907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:17.438907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:17.438907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:17.441156 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-266585382',display_name='tempest-VolumesAssistedSnapshotsTest-server-266585382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesassistedsnapshotstest-server-266585382',id=5,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvP4Qn2q7ltKLHrI6Q/OwekbecQ4F6ipIQSptt49HOaSkjD/NNG3s4UIy2AQ/QziHt1yhIE/LIRq5YEuRbH6I9SCBHHVjaHboHn5EU/s3UpHaULWDWaVZ+XRuTDMDNEsw==',key_name='tempest-keypair-251811921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83195f6b3c514bc5b4441b6ede42e72e',ramdisk_id='',reservation_id='r-v44vw9ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-157421557',owner_user_name='tempest-VolumesAssistedSnapshotsTest-157421557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9171624056948e9898538cd5b0e0f9b',uuid=f444aa34-be20-4e14-acd9-19c487ab903f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:17.441156 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converting VIF {"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:17.442293 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:17.442692 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:17.443300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.443700 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:17.444147 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:17.448859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.450030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f14cbff-7f60-54c0-afb0-12747f6aec03', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:17.452197 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:17.461458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.466542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.466542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape571c1f8-0f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:17.466542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape571c1f8-0f, col_values=(('qos', UUID('a2d58b8a-7843-428b-ab6f-9c2c792c2e2b')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:17.466542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape571c1f8-0f, col_values=(('external_ids', {'iface-id': 'e571c1f8-0f1f-4c5d-9b08-4fe2020002cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:88:9e', 'vm-uuid': 'f444aa34-be20-4e14-acd9-19c487ab903f'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:17.468709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.468709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:17.488126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.489237 np0000000741 nova-compute[97948]: INFO os_vif [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f')
May 14 03:33:17.495084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:17.495313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquired lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:17.495460 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:17.539772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.496s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:17.540154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:17.541870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.359s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:17.544839 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:33:17.545020 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Claim successful on node np0000000741
May 14 03:33:17.579924 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:17.580846 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:17.581520 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Creating image(s)
May 14 03:33:17.581964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:17.582145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:17.582657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:17.583145 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:17.585889 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:17.588875 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.654196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.654196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:17.656128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:17.656128 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:17.659891 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:17.659891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.727828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.068s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.728196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.766229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk 1073741824" returned: 0 in 0.038s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.766670 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.112s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:17.767011 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.774850 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:17.777720 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729597.7773423, 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:17.777887 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] VM Resumed (Lifecycle Event)
May 14 03:33:17.794369 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:17.818415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.851162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.851483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.852755 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:33:17.852974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:17.867661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.915896 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Took 14.72 seconds to build instance.
May 14 03:33:17.950164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:17.952902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:17.953165 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Cannot resize image /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:33:17.953525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:33:17.953812 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Ensure instance console log exists: /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:17.955016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:17.955016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:17.955016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:18.010791 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Creating config drive at /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/disk.config
May 14 03:33:18.016402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk9zda_4w {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:18.054276 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:18.054276 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:18.054674 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:18.054977 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:18.062609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk9zda_4w" returned: 0 in 0.046s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:18.108729 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:18.159390 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.170724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.182082 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.200187 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '268a04e0eb684905bd884ec47edd208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10298a13b54449ba0a0421dd9982254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:18.216280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.226455 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.287992 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:18.296322 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:18.389533 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:18.418313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73e07c71-6354-49d1-b529-45be7e2c49e1 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.234s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:18.462014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-changed-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:18.463633 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Refreshing instance network info cache due to event network-changed-c089441d-bae2-4d49-a901-db7d9bc95f20. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:18.463834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] Acquiring lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:18.467136 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:18.468081 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:18.468835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:18.468835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:18.468835 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Processing event network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:18.468835 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:18.468977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:18.469059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:18.469272 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:18.469394 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] No waiting events found dispatching network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:18.469557 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received unexpected event network-vif-plugged-addbb048-98d8-4138-aa85-41273c86da0c for instance with vm_state building and task_state spawning.
May 14 03:33:18.470482 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:18.471419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:18.471536 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:18.471646 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:18.471773 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] No event matching network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb in dict_keys([('network-vif-plugged', 'e571c1f8-0f1f-4c5d-9b08-4fe2020002cb')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:18.472104 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-184c1acf-56cc-449c-8c9f-47d543ac6603 req-cf491504-b3d9-456a-879b-a27a49867749 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received unexpected event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb for instance with vm_state building and task_state spawning.
May 14 03:33:18.472858 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:18.476346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:18.478473 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Instance spawned successfully.
May 14 03:33:18.478802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:18.534335 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.561291 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.561655 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.561896 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.562119 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.565459 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:18.565630 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.566366 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.570329 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.570584 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:33:18.570865 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:33:18.608200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.611083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.669291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.687844 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updating instance_info_cache with network_info: [{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:18.805780 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729598.8029397, 17280e5e-874d-407f-9a58-710dd3633f6b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:18.805780 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] VM Resumed (Lifecycle Event)
May 14 03:33:18.921946 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.929968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.933829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.956164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.956949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:18.993031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:19.011531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:19.011728 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:19.011855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] No VIF found with MAC fa:16:3e:73:88:9e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:19.012262 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Using config drive
May 14 03:33:19.070619 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] No event matching network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d in dict_keys([('network-vif-plugged', 'bf614564-cbed-475f-a34c-341baa20235d')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:19.079775 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-cbde94c0-c9bf-43e0-8ef4-550fc4d3028a req-e40a48b4-b16c-4f8d-ac55-ebccd3c6ac77 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received unexpected event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d for instance with vm_state building and task_state spawning.
May 14 03:33:19.083815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:19.181562 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:19.181853 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:19.190671 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Releasing lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:19.191323 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Instance network_info: |[{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:19.196663 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Start _get_guest_xml network_info=[{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:19.196663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] Acquired lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:19.196663 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Refreshing network info cache for port c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:19.204957 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:19.206549 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1771135874-1', uuid='c2f3a900-f95f-44ca-832c-117a1239d831'), owner=OwnerMeta(userid='268a04e0eb684905bd884ec47edd208d', username='tempest-TestMultiAttachVolumeSwap-1464080636-project-member', projectid='e10298a13b54449ba0a0421dd9982254', projectname='tempest-TestMultiAttachVolumeSwap-1464080636'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729599.2060099) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:19.212994 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:19.213817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:19.215052 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:19.215211 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:19.216071 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:19.216404 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:19.216508 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:19.216593 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:19.216759 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:19.217323 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:19.217425 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:19.217593 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:19.217752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:19.217855 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:19.217946 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:19.218054 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:19.233518 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-1',id=6,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c2f3a900-f95f-44ca-832c-117a1239d831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:19.233730 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:19.236743 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:19.238147 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'pci_devices' on Instance uuid c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:19.311915 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:19.318473 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:19.500318 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Took 22.33 seconds to spawn the instance on the hypervisor.
May 14 03:33:19.500490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:19.510920 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Successfully created port: d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:19.523252 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:19.674154 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Creating config drive at /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.config
May 14 03:33:19.680140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj95g4mb {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:19.690379 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:19.701353 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:19.712351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj95g4mb" returned: 0 in 0.032s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:19.745731 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <uuid>c2f3a900-f95f-44ca-832c-117a1239d831</uuid>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <name>instance-00000006</name>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1771135874-1</nova:name>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:19</nova:creationTime>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:user uuid="268a04e0eb684905bd884ec47edd208d">tempest-TestMultiAttachVolumeSwap-1464080636-project-member</nova:user>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:project uuid="e10298a13b54449ba0a0421dd9982254">tempest-TestMultiAttachVolumeSwap-1464080636</nova:project>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         <nova:port uuid="c089441d-bae2-4d49-a901-db7d9bc95f20">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="serial">c2f3a900-f95f-44ca-832c-117a1239d831</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="uuid">c2f3a900-f95f-44ca-832c-117a1239d831</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.config"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:45:af:c5"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <target dev="tapc089441d-ba"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/console.log" append="off"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:19.745731 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:19.748479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Preparing to wait for external event network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:19.748479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:19.748479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:19.748479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:19.750354 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-1',id=6,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c2f3a900-f95f-44ca-832c-117a1239d831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:19.750354 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:19.750354 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:19.750592 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:19.750908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.751229 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:19.751763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:19.752618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.752786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b677554-bab5-5de8-9e92-d3bf24b5d13c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:19.753489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.754872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:19.758948 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.762809 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.762992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc089441d-ba, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:19.763313 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc089441d-ba, col_values=(('qos', UUID('7c25cd29-598f-4224-8303-85774d29bc37')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:19.763472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc089441d-ba, col_values=(('external_ids', {'iface-id': 'c089441d-bae2-4d49-a901-db7d9bc95f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:af:c5', 'vm-uuid': 'c2f3a900-f95f-44ca-832c-117a1239d831'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:19.764228 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.765407 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:19.776180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:19.777987 np0000000741 nova-compute[97948]: INFO os_vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba')
May 14 03:33:19.825922 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:33:19.826207 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729599.8260005, ed521445-93a9-42d1-bd32-da5d03ecfe95 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:19.826330 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] VM Started (Lifecycle Event)
May 14 03:33:20.023845 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Took 27.60 seconds to build instance.
May 14 03:33:20.078884 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:20.080275 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:20.080627 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Creating image(s)
May 14 03:33:20.080951 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.081125 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.081569 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.082595 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:20.085190 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:20.086486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:20.132197 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:20.157929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.071s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:20.158311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.158862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.159250 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:20.161876 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:33:20.162380 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:20.176159 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Successfully updated port: d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:20.208458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.667s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.208900 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:33:20.211617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.128s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.211852 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.212015 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:33:20.239359 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:20.239806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:20.240197 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.271164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.284452 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updated VIF entry in instance network info cache for port c089441d-bae2-4d49-a901-db7d9bc95f20. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:33:20.284994 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updating instance_info_cache with network_info: [{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:20.295370 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk 1073741824" returned: 0 in 0.055s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:20.300870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.300870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:20.330241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:20.333907 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729600.3334782, ed521445-93a9-42d1-bd32-da5d03ecfe95 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:20.334139 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] VM Paused (Lifecycle Event)
May 14 03:33:20.370916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.380576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.082s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:20.381039 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:33:20.381171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:20.454917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:20.454917 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:33:20.454917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:33:20.455264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Ensure instance console log exists: /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:20.456697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.456697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.456697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.526680 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c01594e1-ccc8-466f-b94b-33822f6b36d9 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.108s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.552879 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:20.552879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.553210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.553210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.553423 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Processing event network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:20.553549 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:20.554037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:20.554205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.554365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.554824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.555062 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] No waiting events found dispatching network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:20.555221 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received unexpected event network-vif-plugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 for instance with vm_state building and task_state spawning.
May 14 03:33:20.555361 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:20.555494 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing instance network info cache due to event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:20.555698 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Acquiring lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:20.555939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Acquired lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:20.556084 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing network info cache for port d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:20.563087 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:20.570325 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance spawned successfully.
May 14 03:33:20.570685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:20.579741 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55aac771-048c-48a8-bd15-80d608802ae1 req-695ea335-9221-4813-a432-ad990c24ea24 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:20.580434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55aac771-048c-48a8-bd15-80d608802ae1 req-695ea335-9221-4813-a432-ad990c24ea24 service nova] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:20.581294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55aac771-048c-48a8-bd15-80d608802ae1 req-695ea335-9221-4813-a432-ad990c24ea24 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:20.581294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55aac771-048c-48a8-bd15-80d608802ae1 req-695ea335-9221-4813-a432-ad990c24ea24 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:20.581294 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55aac771-048c-48a8-bd15-80d608802ae1 req-695ea335-9221-4813-a432-ad990c24ea24 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Processing event network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:20.585572 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.591808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.595532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.619374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.630145 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:20.680718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:20.718057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:33:20.719254 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:33:20.719254 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:20.719384 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:20.790548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85a070f9-642b-4192-aab3-0604f72f09cd req-beeb5147-9ea9-4829-bcfd-11a7b99ea6b8 service nova] Releasing lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:20.837559 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:20.844982 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:21.007147 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '018a70105e254d36b7ce8a3fe6bd973c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a911ae5ca594e7eb624869133cb0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:33:21.059875 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:21.080236 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.080399 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.080775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.081099 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.081332 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.081584 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.169573 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:21.187205 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:21.187413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:21.187575 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:21.187780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:21.187936 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Processing event network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:21.188757 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:21.189119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:21.190485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:21.190700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:21.191011 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] No waiting events found dispatching network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:21.191197 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2374e374-d066-46dd-8d70-9c10064bd34c req-0f7d1507-fdc1-42ab-ad67-bf316cf19790 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received unexpected event network-vif-plugged-bf614564-cbed-475f-a34c-341baa20235d for instance with vm_state building and task_state spawning.
May 14 03:33:21.192044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:21.196774 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:21.201690 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance spawned successfully.
May 14 03:33:21.202294 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:21.205906 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.208805 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.208942 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.209387 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.223539 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:33:21.233806 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:21.238451 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:21.241043 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance spawned successfully.
May 14 03:33:21.241438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:21.324088 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:21.324223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:21.324288 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No VIF found with MAC fa:16:3e:45:af:c5, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:21.324713 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Using config drive
May 14 03:33:21.338552 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:21.346213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:21.348920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:21.348920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:21.348920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:21.348920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:21.348920 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:33:21.350477 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729601.348958, 076a3e05-e920-470e-8cef-d7cc0bd1e580 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:21.351098 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] VM Started (Lifecycle Event)
May 14 03:33:21.353571 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Terminating instance
May 14 03:33:21.470496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:21.574927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:21.575183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:21.599748 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Took 11.18 seconds to spawn the instance on the hypervisor.
May 14 03:33:21.600653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:21.667292 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:21.668343 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000006, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.config'
May 14 03:33:21.671717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:21.685533 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully created port: 744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:21.717173 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Took 9.24 seconds to spawn the instance on the hypervisor.
May 14 03:33:21.719857 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:21.752624 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.752624 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.753016 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.753716 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.753911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.754716 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:21.766257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:21.766600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:21.834547 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:21.844397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-42e493f9-e15f-40c2-a578-17b849affdd0 req-75b9f409-c7bc-492c-8e06-31fd215cf755 service nova] Releasing lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:21.846681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquired lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:21.847111 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:21.858145 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:21.860424 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:21.860924 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:21.866399 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:33:21.871751 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:21.911003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:21.915370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:21.932472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:21.951722 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:21.983764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:21.998674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:21.999157 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.093005 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Creating config drive at /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.config
May 14 03:33:22.093763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.103007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb3a3jwul {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.113194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.136505 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Took 19.37 seconds to build instance.
May 14 03:33:22.146483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb3a3jwul" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.207173 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.248839 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.251893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.253518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.271528 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Took 18.81 seconds to build instance.
May 14 03:33:22.288041 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Took 7.29 seconds to spawn the instance on the hypervisor.
May 14 03:33:22.292757 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:22.377710 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729602.37336, 076a3e05-e920-470e-8cef-d7cc0bd1e580 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:22.380129 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] VM Paused (Lifecycle Event)
May 14 03:33:22.389249 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully created port: a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:22.406206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.410808 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:33:22.417192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.501769 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:22.504505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.505059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.603697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.610455 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:22.611693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:22.635665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.642683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.881s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:22.651013 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.652868 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.655189 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:22.655592 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=14730MB free_disk=74.78564834594727GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:33:22.655838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:22.656815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:22.682185 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.701450 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.753234 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:33:22.792301 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b9f0978-b6eb-4d32-9fb7-719c7c2f84db tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.334s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:22.800990 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:22.810804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Took 17.17 seconds to build instance.
May 14 03:33:22.834731 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Instance destroyed successfully.
May 14 03:33:22.837479 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lazy-loading 'resources' on Instance uuid 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:22.840065 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.870632 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:22.870799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:22.873428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:22.874676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.877575 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:22.877798 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] No waiting events found dispatching network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:22.878631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2bab08d5-0692-4d6e-a0c1-5fd989083b56 req-7da8d203-8f5b-4333-9e44-6fd0b737940a service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:22.881294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.887459 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:22.889832 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:22.904690 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:22.905372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.911074 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:22.916683 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:22.916683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:22.916880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:22.916970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:22.917155 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] No waiting events found dispatching network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:22.918924 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3feacd0f-7020-4552-96cf-2f185c5d1e40 req-6e9d3632-aa3d-45de-ab3c-d1f27ec3e1ee service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received unexpected event network-vif-plugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb for instance with vm_state active and task_state None.
May 14 03:33:22.920302 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729602.9199944, 076a3e05-e920-470e-8cef-d7cc0bd1e580 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:22.920677 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] VM Resumed (Lifecycle Event)
May 14 03:33:23.016525 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.094577 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:23.161308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.241859 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully created port: 7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:23.261814 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Booting with volume 6d12ec63-80b5-44bc-a32e-991a977db826 at /dev/vda
May 14 03:33:23.313587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e77011c-7ad2-407d-9c08-ede3e16cd392 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.694s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:23.329960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.337953 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494980965',display_name='tempest-VolumesAdminNegativeTest-server-494980965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesadminnegativetest-server-494980965',id=3,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:17Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4668ce4dcf7f40578e28a10b4ef8fff5',ramdisk_id='',reservation_id='r-n7bo5aig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1946600030',owner_user_name='tempest-VolumesAdminNegativeTest-1946600030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:17Z,user_data=None,user_id='5f0aeede522c40ebb7a930cc705ced61',uuid=1ed891f3-7c51-4d5a-a71c-b81a64339bb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:33:23.338149 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converting VIF {"id": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "address": "fa:16:3e:0f:19:e4", "network": {"id": "95a3033c-5e9b-41e9-9728-1d4bddacf6b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1531549158-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4668ce4dcf7f40578e28a10b4ef8fff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a18d9f-ca", "ovs_interfaceid": "12a18d9f-ca42-47d7-9ba6-8b2ad74a7612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:23.339943 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:23.339943 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:33:23.340058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.351255 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:23.352859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.353061 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12a18d9f-ca, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:23.354626 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.357142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:23.369290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.370228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:33:23.372137 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.373302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.376071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=488dbef2-c66e-452a-a62e-bb167df0a77f) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:23.376071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.376571 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:23.379433 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:23.383376 np0000000741 nova-compute[97948]: INFO os_vif [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:19:e4,bridge_name='br-int',has_traffic_filtering=True,id=12a18d9f-ca42-47d7-9ba6-8b2ad74a7612,network=Network(95a3033c-5e9b-41e9-9728-1d4bddacf6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a18d9f-ca')
May 14 03:33:23.383376 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Deleting instance files /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2_del
May 14 03:33:23.384356 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Deletion of /opt/stack/data/nova/instances/1ed891f3-7c51-4d5a-a71c-b81a64339bb2_del complete
May 14 03:33:23.396858 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lazy-loading 'flavor' on Instance uuid 17280e5e-874d-407f-9a58-710dd3633f6b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:23.416581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:23.429229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:23.438810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:23.447742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:33:23.448465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:33:23.462985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:33:23.465249 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5b:adc', 'fe80::142a:98ff:fed0:ce5c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe66:28af', 'fe80::8836:a6ff:fe23:a397', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb'] 
May 14 03:33:23.465713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:33:23.465927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:33:23.469987 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:23.470960 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating existing volume attachment record: f4240c05-cd61-48e5-890d-f9a3acd0ad4c {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:33:23.606024 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Releasing lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:23.606024 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance network_info: |[{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:23.611902 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Start _get_guest_xml network_info=[{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:23.621664 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:23.625097 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1771135874-2', uuid='c3ced606-f7f2-4b81-974d-4c064e3801d1'), owner=OwnerMeta(userid='268a04e0eb684905bd884ec47edd208d', username='tempest-TestMultiAttachVolumeSwap-1464080636-project-member', projectid='e10298a13b54449ba0a0421dd9982254', projectname='tempest-TestMultiAttachVolumeSwap-1464080636'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729603.6233048) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:23.629706 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:23.630470 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:23.632152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:23.632380 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:23.633626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:23.634005 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:23.634280 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:23.634403 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:23.634516 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:23.634608 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:23.634744 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:23.635004 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:23.635206 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:23.635301 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:23.635416 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:23.635795 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:23.647416 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-2',id=7,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c3ced606-f7f2-4b81-974d-4c064e3801d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:23.647653 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:23.648401 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:23.648907 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:23.735470 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 17280e5e-874d-407f-9a58-710dd3633f6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.735599 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 076a3e05-e920-470e-8cef-d7cc0bd1e580 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.735729 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.735821 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ed521445-93a9-42d1-bd32-da5d03ecfe95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.735936 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f444aa34-be20-4e14-acd9-19c487ab903f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.737676 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c2f3a900-f95f-44ca-832c-117a1239d831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.737676 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c3ced606-f7f2-4b81-974d-4c064e3801d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.737676 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 32cb8438-d425-4069-84c9-35886e83c12d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:33:23.737676 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:33:23.737676 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:33:22 up 25 min,  2 users,  load average: 5.36, 2.54, 1.26\n', 'num_instances': '8', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '8', 'num_proj_11009575893b46008850ca3ba381844f': '1', 'io_workload': '3', 'num_proj_e47b3ce0f3324e16883e5d4f93f2c764': '1', 'num_task_deleting': '1', 'num_proj_4668ce4dcf7f40578e28a10b4ef8fff5': '1', 'num_proj_20d8ae1101e445b1b2e501e52a2d3f90': '1', 'num_proj_83195f6b3c514bc5b4441b6ede42e72e': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_e10298a13b54449ba0a0421dd9982254': '2', 'num_task_networking': '1', 'num_proj_3a911ae5ca594e7eb624869133cb0973': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:33:23.877310 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully created port: aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:23.912006 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Took 2.04 seconds to destroy the instance on the hypervisor.
May 14 03:33:23.913153 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:33:23.913388 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:33:23.913538 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:33:23.913951 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:23.952560 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729603.9521663, ed521445-93a9-42d1-bd32-da5d03ecfe95 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:23.952707 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] VM Resumed (Lifecycle Event)
May 14 03:33:24.152972 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <uuid>c3ced606-f7f2-4b81-974d-4c064e3801d1</uuid>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <name>instance-00000007</name>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1771135874-2</nova:name>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:23</nova:creationTime>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:user uuid="268a04e0eb684905bd884ec47edd208d">tempest-TestMultiAttachVolumeSwap-1464080636-project-member</nova:user>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:project uuid="e10298a13b54449ba0a0421dd9982254">tempest-TestMultiAttachVolumeSwap-1464080636</nova:project>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         <nova:port uuid="d5cff4c1-8912-41dc-97c5-aa9ad87391c5">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="serial">c3ced606-f7f2-4b81-974d-4c064e3801d1</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="uuid">c3ced606-f7f2-4b81-974d-4c064e3801d1</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.config"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:aa:0a:6a"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <target dev="tapd5cff4c1-89"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/console.log" append="off"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:24.152972 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:24.155566 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Preparing to wait for external event network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:24.155566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:24.155566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:24.155566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:24.155566 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-2',id=7,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c3ced606-f7f2-4b81-974d-4c064e3801d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:24.156753 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:24.156753 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:24.156942 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:24.157537 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.159008 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:24.159461 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:24.161354 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.161354 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d38b7dc-537c-5140-99ad-fed55d2cb57d', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:24.163744 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.163744 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:24.164429 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.166771 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.169968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5cff4c1-89, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:24.169968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5cff4c1-89, col_values=(('qos', UUID('858814c3-73c9-4408-961f-b899f93e293a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:24.169968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5cff4c1-89, col_values=(('external_ids', {'iface-id': 'd5cff4c1-8912-41dc-97c5-aa9ad87391c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:0a:6a', 'vm-uuid': 'c3ced606-f7f2-4b81-974d-4c064e3801d1'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:24.172999 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:24.178155 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.178155 np0000000741 nova-compute[97948]: INFO os_vif [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89')
May 14 03:33:24.292815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:24.293944 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:24.366683 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:24.409773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:24.416787 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully created port: b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:33:24.457441 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:24.459424 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:24.565740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:24.796690 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:24.931940 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-changed-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:24.932067 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Refreshing instance network info cache due to event network-changed-bf614564-cbed-475f-a34c-341baa20235d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:24.932202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] Acquiring lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:24.932300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] Acquired lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:24.932416 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Refreshing network info cache for port bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:24.963410 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729604.9630716, f444aa34-be20-4e14-acd9-19c487ab903f => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:24.963559 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] VM Started (Lifecycle Event)
May 14 03:33:25.136756 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Booting with volume 3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f at /dev/vdb
May 14 03:33:25.204925 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:25.209163 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:25.215539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:33:25.237977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:25.264183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:33:25.268367 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: 744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:25.270434 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:33:25.282178 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:33:25.283779 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5b:adc', 'fe80::142a:98ff:fed0:ce5c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe66:28af', 'fe80::8836:a6ff:fe23:a397', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb'] 
May 14 03:33:25.283966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:33:25.284061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:33:25.284211 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:25.284543 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating existing volume attachment record: e2ee30c5-d354-407f-a509-5c10f912487a {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:33:25.308334 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:33:25.308334 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.652s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:25.309009 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.21 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:33:25.388340 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:25.388340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Acquiring lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:25.388586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:25.388775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:25.388938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] No waiting events found dispatching network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:25.389104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-unplugged-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:25.389260 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:25.389439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:25.389617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:25.396127 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:25.396404 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Processing event network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:25.396726 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:25.396859 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:25.397407 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:25.397652 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:25.398209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:25.398209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] No waiting events found dispatching network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:25.398209 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-03359ba5-d9b3-45fd-8763-d3f837f8aee0 req-22caeb9a-b46c-4f74-a49b-7fd9bfdf3993 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received unexpected event network-vif-plugged-c089441d-bae2-4d49-a901-db7d9bc95f20 for instance with vm_state building and task_state spawning.
May 14 03:33:25.405483 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:25.409124 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Instance spawned successfully.
May 14 03:33:25.409945 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:25.418465 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f081135-b611-4f06-bd85-702366836fd2 req-0b9498c6-91b7-4887-8bac-8c277d569fe7 service nova] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Received event network-vif-deleted-12a18d9f-ca42-47d7-9ba6-8b2ad74a7612 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:25.436040 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:25.469014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:25.472127 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:25.703320 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:25.703459 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:25.703589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No VIF found with MAC fa:16:3e:aa:0a:6a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:25.704309 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Using config drive
May 14 03:33:25.713041 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Took 1.80 seconds to deallocate network for instance.
May 14 03:33:25.894904 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:25.923769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.925664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.925664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.925664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.925664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.925664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:25.976134 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729605.9757683, f444aa34-be20-4e14-acd9-19c487ab903f => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:25.976312 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] VM Paused (Lifecycle Event)
May 14 03:33:26.077325 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:26.077325 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:26.077481 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Attaching volume b7afe902-6550-412b-811f-3f32833be722 to /dev/vdb
May 14 03:33:26.082799 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updated VIF entry in instance network info cache for port bf614564-cbed-475f-a34c-341baa20235d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:33:26.083082 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating instance_info_cache with network_info: [{"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:26.139664 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:26.155752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:33:26.182603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:26.219683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:33:26.219683 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:26.223413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:33:26.226054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:26.227175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:26.247351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:33:26.247942 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5b:adc', 'fe80::142a:98ff:fed0:ce5c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe66:28af', 'fe80::8836:a6ff:fe23:a397', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb'] 
May 14 03:33:26.248109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:33:26.248256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:33:26.248623 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:26.248837 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updating existing volume attachment record: aef0a5b4-3b6f-4a0d-91ff-29ad0afb2334 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:33:26.434360 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Took 8.85 seconds to spawn the instance on the hypervisor.
May 14 03:33:26.435180 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:26.457994 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Creating config drive at /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.config
May 14 03:33:26.462721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtv2shpx {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:26.488687 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:26.491506 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729606.491141, f444aa34-be20-4e14-acd9-19c487ab903f => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:26.491812 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] VM Resumed (Lifecycle Event)
May 14 03:33:26.501270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtv2shpx" returned: 0 in 0.039s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:26.529871 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:26.590672 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-14f8857b-fa8a-4e8b-9aaf-202774a16609 req-25b511ea-1e25-4232-a60c-83b96934cfaf service nova] Releasing lock "refresh_cache-ed521445-93a9-42d1-bd32-da5d03ecfe95" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:26.804917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:26.805567 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:26.817310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:33:26.817691 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:26.818316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:26.818444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:26.818656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:33:26.831609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:26.832532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:26.832956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:26.833242 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:26.833538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:26.833765 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:26.849394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:26.849394 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:26.859137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:26.859137 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:26.864446 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722] added
May 14 03:33:26.864446 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:26.864446 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:26.864446 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:26.864446 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:26.864446 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:26.864446 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:26.864582 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:26.864752 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:26.864915 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722] added
May 14 03:33:26.873301 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:26.873301 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:26.873301 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:26.947233 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Took 17.06 seconds to build instance.
May 14 03:33:26.992069 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Booting with volume 86362a6a-4ab1-452e-b99b-16c52823980c at /dev/vdc
May 14 03:33:26.996528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:27.002189 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:27.016578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:27.025798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:27.069909 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:27.085604 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:33:27.115691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:27.134137 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:27.148687 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:33:27.148687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:33:27.156915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:27.163023 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:33:27.164540 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5b:adc', 'fe80::142a:98ff:fed0:ce5c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe66:28af', 'fe80::8836:a6ff:fe23:a397', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a'] 
May 14 03:33:27.164710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:33:27.164818 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:33:27.165136 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:27.165319 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating existing volume attachment record: 830b9c73-89d2-46f5-bbee-5f539619d83d {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:33:27.309348 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:27.338343 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-changed-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:27.338530 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Refreshing instance network info cache due to event network-changed-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:27.339876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Acquiring lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:27.339876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Acquired lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:27.339876 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Refreshing network info cache for port e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:27.448954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.569s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:27.498574 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:27.501154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-744344e1-b2f8-4495-89b2-9e5b882480bc. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:27.501154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:27.501154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:27.501154 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port 744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:27.511076 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998953483999912 future=<Future at 0x79d0c0148860 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:27.515110 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.994898057 future=<Future at 0x79d0c0148860 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:27.518358 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729607.5168386, c2f3a900-f95f-44ca-832c-117a1239d831 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:27.518726 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.991267423999943 future=<Future at 0x79d0c0148860 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:27.523314 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] VM Started (Lifecycle Event)
May 14 03:33:27.529780 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c55a4c57-06cf-4181-997f-dd3ff244c345 req-f3a70dee-8cad-4913-a41d-389ca0ac754c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:27.529971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c55a4c57-06cf-4181-997f-dd3ff244c345 req-f3a70dee-8cad-4913-a41d-389ca0ac754c service nova] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:27.530886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c55a4c57-06cf-4181-997f-dd3ff244c345 req-f3a70dee-8cad-4913-a41d-389ca0ac754c service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:27.530886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c55a4c57-06cf-4181-997f-dd3ff244c345 req-f3a70dee-8cad-4913-a41d-389ca0ac754c service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:27.530886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c55a4c57-06cf-4181-997f-dd3ff244c345 req-f3a70dee-8cad-4913-a41d-389ca0ac754c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Processing event network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:27.824323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.598s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:27.844691 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:27.865920 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:27.877978 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:27.884229 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:27.884229 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:27.895511 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:27.895511 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.905718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.912024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.923195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.923195 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.923195 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:27.923387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.923387 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.923387 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:27.925347 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Deleted allocations for instance 1ed891f3-7c51-4d5a-a71c-b81a64339bb2
May 14 03:33:27.931435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.931435 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.931435 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:27.931955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.931955 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:27.931955 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:27.958369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.50.100,3260]
May 14 03:33:27.958369 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.50.100,3260] successful.
May 14 03:33:27.958369 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.974749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.40.100,3260]
May 14 03:33:27.974749 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.40.100,3260] successful.
May 14 03:33:27.974749 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.980697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:27.991077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:28.007916 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:28.016747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.016747 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.016747 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.016747 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.016747 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:28.018031 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018031 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018031 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018031 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018031 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:28.018974 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:28.019417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:28.019417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:28.020242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:28.020363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:28.020912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:28.021022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:28.021577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:28.021731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:28.029031 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:28.036198 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:28.052731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:28.052858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:28.083139 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:28.090225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:28.090503 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:28.160421 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:28.167091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:28.223458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:33:28.228067 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:33:28.231487 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance spawned successfully.
May 14 03:33:28.232363 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:33:28.423595 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:28.441304 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:28.539369 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729608.538986, c2f3a900-f95f-44ca-832c-117a1239d831 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:28.539957 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] VM Paused (Lifecycle Event)
May 14 03:33:28.651096 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updated VIF entry in instance network info cache for port e571c1f8-0f1f-4c5d-9b08-4fe2020002cb. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:33:28.651096 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating instance_info_cache with network_info: [{"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:28.741791 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.741962 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.742347 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.742559 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.742892 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.744135 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:33:28.833706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:33:28.926050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6cd3d30-ddcc-410b-a92f-c5ae0a3e5e6c req-b0846072-740f-4f25-bafb-cde26c718615 service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:28.941239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58ef1e18-74a9-47ac-b93d-1ec247c70b01 tempest-VolumesAdminNegativeTest-1946600030 tempest-VolumesAdminNegativeTest-1946600030-project-member] Lock "1ed891f3-7c51-4d5a-a71c-b81a64339bb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.595s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:29.048949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:29.050923 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729609.0504692, c2f3a900-f95f-44ca-832c-117a1239d831 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:29.050923 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] VM Resumed (Lifecycle Event)
May 14 03:33:29.155506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Releasing lock "refresh_cache-f444aa34-be20-4e14-acd9-19c487ab903f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:29.155746 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:29.155923 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-a48b3dfc-3d84-4ab7-b620-cebe09037d71. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:29.156104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:29.156233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:29.156396 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:29.172494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:29.256207 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Took 9.18 seconds to spawn the instance on the hypervisor.
May 14 03:33:29.256207 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:29.259905 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:29.351605 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:33:29.352613 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:33:29.352887 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Creating image(s)
May 14 03:33:29.353201 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:33:29.353372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Ensure instance console log exists: /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:33:29.353574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:29.354229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:29.354541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:29.558481 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:29.561131 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:29.585689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:29.585689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-a061b1c3-6cc7-4056-a432-29d76d3cfef0. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:29.585689 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:29.634907 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:29.635558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:29.635795 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:29.635982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:29.636364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] No waiting events found dispatching network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:29.636871 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received unexpected event network-vif-plugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 for instance with vm_state active and task_state None.
May 14 03:33:29.636937 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:29.637042 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-f74f34b2-c049-43f3-b870-a0c6f42ab0d2. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:29.637208 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:29.660973 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:29.772693 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Took 19.82 seconds to build instance.
May 14 03:33:29.793434 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:29.856881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Found WWN 3300000009473d812 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:33:29.856881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:29.857132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000009473d812', 'path': '/dev/dm-1', 'multipath_id': '3300000009473d812'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:29.857132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009473d812', 'path': '/dev/dm-1', 'multipath_id': '3300000009473d812'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:33:29.859478 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lazy-loading 'flavor' on Instance uuid 17280e5e-874d-407f-9a58-710dd3633f6b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:30.063909 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729610.0634525, c3ced606-f7f2-4b81-974d-4c064e3801d1 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:30.063909 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] VM Started (Lifecycle Event)
May 14 03:33:30.276029 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.347s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:30.363274 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Attempting to attach volume b7afe902-6550-412b-811f-3f32833be722 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:33:30.365110 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:   <alias name="ua-b7afe902-6550-412b-811f-3f32833be722"/>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:   <serial>b7afe902-6550-412b-811f-3f32833be722</serial>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]: </disk>
May 14 03:33:30.365110 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:33:30.483363 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: 7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:30.489318 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:30.567334 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:30.581568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:30.685124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:30.991543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55de5b19-d9f9-41b2-8de7-cb6b2278cd36 req-a4c3ef65-4fba-4e74-8a45-215c867a8c3d service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:30.992497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:30.992744 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:31.086515 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:31.086703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:31.086862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:31.087034 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:31.087079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:31.088503 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729611.0882125, c3ced606-f7f2-4b81-974d-4c064e3801d1 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:31.089020 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] VM Paused (Lifecycle Event)
May 14 03:33:31.093615 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Terminating instance
May 14 03:33:31.498146 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:31.595173 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:31.598304 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:31.600419 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729611.6001127, c3ced606-f7f2-4b81-974d-4c064e3801d1 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:31.600757 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] VM Resumed (Lifecycle Event)
May 14 03:33:31.603114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:33:31.635294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.639818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.656653 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.668818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.693346 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:31.696036 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-aba7e22f-3355-445f-a830-c60dba6d8ae1. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:31.696036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:31.696036 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.698077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.796630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:31.797488 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:31.797751 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:31.937677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.955467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:31.975206 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Instance destroyed successfully.
May 14 03:33:31.975963 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lazy-loading 'resources' on Instance uuid 076a3e05-e920-470e-8cef-d7cc0bd1e580 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:32.077310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:32.077823 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:32.079041 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:32.079240 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] No VIF found with MAC fa:16:3e:5b:0a:dc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:32.108057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:32.111342 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:33:32.132758 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:32.479707 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='instance-depend-image',id=2,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:21Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e47b3ce0f3324e16883e5d4f93f2c764',ramdisk_id='',reservation_id='r-iqemyd1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1227918501',owner_user_name='tempest-ImageDependencyTests-1227918501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:22Z,user_data=None,user_id='42ea6f631ead49f187123675fdf49dea',uuid=076a3e05-e920-470e-8cef-d7cc0bd1e580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:33:32.480026 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converting VIF {"id": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "address": "fa:16:3e:66:28:af", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ec267a3-57", "ovs_interfaceid": "5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:32.480610 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:32.481364 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:33:32.484413 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:32.484668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ec267a3-57, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:32.490751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:32.493144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:32.496028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:32.496028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29ad7033-cead-4ba3-bc2f-aa78dd0cd104) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:32.498193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:32.502073 np0000000741 nova-compute[97948]: INFO os_vif [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:28:af,bridge_name='br-int',has_traffic_filtering=True,id=5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ec267a3-57')
May 14 03:33:32.504941 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:33:32.504941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:32.504941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:32.505543 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:32.505756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e027d315-5771-46c1-b135-f1d6ee609c95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:33:32.505956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:32.539669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '8')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', '6')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95', '5')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:33:32.539669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8175260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'): ({'sdb'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:33:32.541728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:33:32.542101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Flush multipath device 33000000092b54080 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:33:32.565820 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:32.579008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:33:32.618140 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99973112900011 future=<Future at 0x79d0b071ca10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:32.627894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:33:32.669726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:33:32.669917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:33:32.670942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:33:32.684019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:33:32.684723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:33:32.699258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.735175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.40.100,3260]
May 14 03:33:32.735175 np0000000741 nova-compute[97948]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.40.100,3260] successful.
May 14 03:33:32.735175 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.751583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.770042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.809237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.50.100,3260]
May 14 03:33:32.809237 np0000000741 nova-compute[97948]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e027d315-5771-46c1-b135-f1d6ee609c95, portal: 192.168.50.100,3260] successful.
May 14 03:33:32.809237 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.824015 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Successfully updated port: b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:33:32.827664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:32.828284 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:32.828667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] <== disconnect_volume: return (323ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:32.829028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:33:32.831706 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Deleting instance files /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580_del
May 14 03:33:32.831706 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Deletion of /opt/stack/data/nova/instances/076a3e05-e920-470e-8cef-d7cc0bd1e580_del complete
May 14 03:33:32.925420 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:32.926023 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-b9f6fa62-7146-452e-a16c-ff2c8d82625c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:32.926023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:33.078725 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-624975ae-f735-4fd4-91ac-d59b747442c8 req-97f802c6-418e-4a04-942b-337a6d460a16 service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:33.080829 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:33.081046 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:33.238436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:33.242811 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:33.326612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:33.336320 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Took 1.73 seconds to destroy the instance on the hypervisor.
May 14 03:33:33.337669 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:33:33.337826 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:33:33.337936 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:33:33.338243 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:33.423170 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:33.586710 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:33.662291 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88eee326-b547-4dfd-9029-5eeb4d349359 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.585s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:33.694037 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:33.795614 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:33.795885 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:33.796060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:33.796228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:33.796381 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] No waiting events found dispatching network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:33.796521 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:33.796672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:33.796818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Acquiring lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:33.796956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:33.797102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:33.797207 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] No waiting events found dispatching network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:33.797334 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-564abd9c-8ba7-4ccc-a2b6-24b11d3025e5 req-2be89a8c-4d40-45c0-bc99-40094837b8e8 service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-unplugged-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:33.893300 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:33.893300 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing instance network info cache due to event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:33:33.893300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] Acquiring lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:33:33.893300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] Acquired lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:33.893300 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing network info cache for port d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:33.909653 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:34.242384 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:34.395961 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:34.412548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-16c0cb6d-710b-498c-b100-acb383ac80e6 req-4991f031-08c8-4fec-ac5b-4bd607898239 service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:34.413799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:34.413975 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:34.744913 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Took 1.41 seconds to deallocate network for instance.
May 14 03:33:34.780566 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:34.817266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:34.819790 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:34.819983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:34.820220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:34.820345 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:34.823918 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Terminating instance
May 14 03:33:34.918360 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:34.966902 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updated VIF entry in instance network info cache for port d5cff4c1-8912-41dc-97c5-aa9ad87391c5. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:33:34.967225 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:35.047810 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:35.243415 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:35.332043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:33:35.356164 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Took 0.61 seconds to detach 1 volumes for instance.
May 14 03:33:35.359802 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Deleting volume: e027d315-5771-46c1-b135-f1d6ee609c95 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:33:35.405310 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.408160 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.409988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.431229 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.434806 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.463871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.464777 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.471154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05c33bca-5068-4dfd-a4bb-17a7e56a8cf1 req-3037e073-0889-4a6f-934c-1b8571351e86 service nova] Releasing lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:35.649795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.661630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:35.691411 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999659771000097 future=<Future at 0x79d0b815ac90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:35.698962 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Instance destroyed successfully.
May 14 03:33:35.701380 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lazy-loading 'resources' on Instance uuid 17280e5e-874d-407f-9a58-710dd3633f6b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:35.744691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4274fe61-d7fe-40c5-8ec3-d75ef80293e0 req-a8b6d552-f5d3-43ea-8062-e7b1f9366b72 service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:35.745110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:35.745497 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port 7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:35.883187 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c7ae2235-2571-4403-90d6-19edf8c755ee req-59b30434-ea94-4d99-9512-f3289f36e73e service nova] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Received event network-vif-deleted-5ec267a3-57cf-4b58-9bdb-7b095ce9f1e9 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:35.951170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:35.951456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:36.008447 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:36.008681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:36.009120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:36.009120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:36.009361 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] No waiting events found dispatching network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:36.009361 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7731d6bc-c60e-4283-a997-4eb40a558cc9 req-a4076be2-4629-4bc5-9250-067d76072a5f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:36.204051 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:32:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-986835989',display_name='tempest-DeleteServersTestJSON-server-986835989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-deleteserverstestjson-server-986835989',id=1,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11009575893b46008850ca3ba381844f',ramdisk_id='',reservation_id='r-p8gmcjwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-323938856',owner_user_name='tempest-DeleteServersTestJSON-323938856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:20Z,user_data=None,user_id='206dd5cfe91b429597edf3e3be05805a',uuid=17280e5e-874d-407f-9a58-710dd3633f6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:33:36.204249 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converting VIF {"id": "addbb048-98d8-4138-aa85-41273c86da0c", "address": "fa:16:3e:5b:0a:dc", "network": {"id": "d3ab144e-544f-4315-b7ca-a2cf84c93cd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1682974353-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11009575893b46008850ca3ba381844f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaddbb048-98", "ovs_interfaceid": "addbb048-98d8-4138-aa85-41273c86da0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:36.204798 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:36.205012 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:33:36.210882 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.210882 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaddbb048-98, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:36.212068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.212068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:36.213243 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.215894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.215894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dcbb858-8951-4bd2-b2c8-74f9812b7178) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:36.216775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.216775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:36.217516 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:36.219452 np0000000741 nova-compute[97948]: INFO os_vif [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:dc,bridge_name='br-int',has_traffic_filtering=True,id=addbb048-98d8-4138-aa85-41273c86da0c,network=Network(d3ab144e-544f-4315-b7ca-a2cf84c93cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaddbb048-98')
May 14 03:33:36.223303 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:33:36.223654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:36.223797 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:36.224376 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:36.224888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7afe902-6550-412b-811f-3f32833be722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:33:36.224888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:33:36.248133 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:36.255103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:36.255103 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:36.255103 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:36.255824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsi session list stdout=tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:36.255824 np0000000741 nova-compute[97948]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722 (non-flash)
May 14 03:33:36.255824 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:36.255824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '8')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:33:36.255824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '8')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:33:36.256370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722', '7')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:33:36.256946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81771a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:33:36.257144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:33:36.257374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Flush multipath device 3300000009473d812 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:33:36.289947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:33:36.341219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:33:36.393403 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:33:36.394811 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:33:36.399917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:33:36.404018 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:36.415157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:33:36.415402 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:33:36.430790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.461129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.40.100,3260]
May 14 03:33:36.461129 np0000000741 nova-compute[97948]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.40.100,3260] successful.
May 14 03:33:36.461129 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.473947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.478414 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:36.478698 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:36.486149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.516926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.50.100,3260]
May 14 03:33:36.516926 np0000000741 nova-compute[97948]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-b7afe902-6550-412b-811f-3f32833be722, portal: 192.168.50.100,3260] successful.
May 14 03:33:36.516926 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.528881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:36.529189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:36.529312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] <== disconnect_volume: return (305ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:36.529422 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:33:36.529723 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Deleting instance files /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b_del
May 14 03:33:36.530443 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Deletion of /opt/stack/data/nova/instances/17280e5e-874d-407f-9a58-710dd3633f6b_del complete
May 14 03:33:36.626021 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:36.983546 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:37.038209 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Took 1.71 seconds to destroy the instance on the hypervisor.
May 14 03:33:37.038806 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:33:37.038978 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:33:37.039061 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:33:37.039302 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:37.127653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ba14a9e4-ad42-4e00-abd6-34f9e8e32d3d req-ab4d8007-babd-4a39-951c-a2c112d012ec service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:37.128527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:37.128798 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:33:37.172284 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:37.491334 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.540s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:37.542475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d79e0852-d1e5-464b-a022-7daf817271e7 req-7dcb7a21-081d-419c-9688-0712b1bcc9d4 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-deleted-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:37.543178 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-d79e0852-d1e5-464b-a022-7daf817271e7 req-7dcb7a21-081d-419c-9688-0712b1bcc9d4 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Neutron deleted interface addbb048-98d8-4138-aa85-41273c86da0c; detaching it from the instance and deleting it from the info cache
May 14 03:33:37.543461 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d79e0852-d1e5-464b-a022-7daf817271e7 req-7dcb7a21-081d-419c-9688-0712b1bcc9d4 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:37.566014 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Deleted allocations for instance 076a3e05-e920-470e-8cef-d7cc0bd1e580
May 14 03:33:37.631110 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:37.852319 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:37.978074 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:38.046650 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:38.048855 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d79e0852-d1e5-464b-a022-7daf817271e7 req-7dcb7a21-081d-419c-9688-0712b1bcc9d4 service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Detach interface failed, port_id=addbb048-98d8-4138-aa85-41273c86da0c, reason: Instance 17280e5e-874d-407f-9a58-710dd3633f6b could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:33:38.107331 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:38.107861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] Acquiring lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:38.108685 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:38.108819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] Lock "17280e5e-874d-407f-9a58-710dd3633f6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:38.109193 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] No waiting events found dispatching network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:33:38.109193 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c0997679-b428-4ae0-a678-5e2fa0d46eeb req-71ae9cd2-5e35-4d5d-9b94-827c9643da9f service nova] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Received event network-vif-unplugged-addbb048-98d8-4138-aa85-41273c86da0c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:33:38.240690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:38.480696 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Took 1.44 seconds to deallocate network for instance.
May 14 03:33:38.548520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea3a1837-b978-4637-abb1-d0c5f1c06385 req-475aef59-fa22-4c87-90a2-94a20760ec38 service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:38.548879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:33:38.549103 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:33:38.574820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-01273b04-20a9-4f35-9ba8-82981ba7351b tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Lock "076a3e05-e920-470e-8cef-d7cc0bd1e580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.488s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:39.057160 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Took 0.57 seconds to detach 1 volumes for instance.
May 14 03:33:39.176789 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:33:39.388369 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:39.562119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:39.562466 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:39.792253 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:39.996182 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:33:39.996370 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:33:40.184069 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:40.503465 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:33:40.615715 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:40.987280 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:41.011702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.449s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:41.099551 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Deleted allocations for instance 17280e5e-874d-407f-9a58-710dd3633f6b
May 14 03:33:41.226950 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:41.419732 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:41.814211 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:42.021716 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:33:42.112202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fcfdbdfb-64bb-425f-a5bd-57e969e4a401 tempest-DeleteServersTestJSON-323938856 tempest-DeleteServersTestJSON-323938856-project-member] Lock "17280e5e-874d-407f-9a58-710dd3633f6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.294s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:42.510849 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000811379999959172 future=<Future at 0x79d0c0148860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:42.511277 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:42.511277 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.106744495000157 future=<Future at 0x79d0b071ca10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:42.511277 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.106644633000087 future=<Future at 0x79d0b071ca10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:42.511939 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778729607.5098934, 1ed891f3-7c51-4d5a-a71c-b81a64339bb2 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:42.512020 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] VM Stopped (Lifecycle Event)
May 14 03:33:42.524198 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:33:42.524612 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance network_info: |[{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:33:42.526027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Start _get_guest_xml network_info=[{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '32cb8438-d425-4069-84c9-35886e83c12d', 'attached_at': '', 'detached_at': '', 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'serial': '6d12ec63-80b5-44bc-a32e-991a977db826'}, 'boot_index': 0, 'attachment_id': 'f4240c05-cd61-48e5-890d-f9a3acd0ad4c', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '32cb8438-d425-4069-84c9-35886e83c12d', 'attached_at': '', 'detached_at': '', 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'serial': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'}, 'boot_index': 1, 'attachment_id': 'e2ee30c5-d354-407f-a509-5c10f912487a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '32cb8438-d425-4069-84c9-35886e83c12d', 'attached_at': '', 'detached_at': '', 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'serial': '86362a6a-4ab1-452e-b99b-16c52823980c'}, 'boot_index': 2, 'attachment_id': '830b9c73-89d2-46f5-bbee-5f539619d83d', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:33:42.529663 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:33:42.530357 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-677097887', uuid='32cb8438-d425-4069-84c9-35886e83c12d'), owner=OwnerMeta(userid='018a70105e254d36b7ce8a3fe6bd973c', username='tempest-TaggedBootDevicesTest-787669211-project-member', projectid='3a911ae5ca594e7eb624869133cb0973', projectname='tempest-TaggedBootDevicesTest-787669211'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729622.5298388) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:33:42.531704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:33:42.532191 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:33:42.533038 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:33:42.533261 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:33:42.534987 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:33:42.534987 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:33:42.534987 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:33:42.535221 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:33:42.535284 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:33:42.535403 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:33:42.535516 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:33:42.535686 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:33:42.536156 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:33:42.537296 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:33:42.537296 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:33:42.537296 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:33:42.548874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:33:42.549258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:42.549927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:42.550087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:42.550285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:33:42.569434 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:42.569434 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:42.569434 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:42.570886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:42.570994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:42.571257 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:42.586159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:42.586159 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:42.588690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:42.588690 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:42.607258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826] added
May 14 03:33:42.607258 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:42.607258 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:42.607258 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:42.607258 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:42.607258 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:42.607258 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:42.607560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:42.607560 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:42.607632 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:42.610886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826] added
May 14 03:33:42.610886 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:42.610886 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:42.610886 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:42.610886 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:42.610886 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:42.610886 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:42.611843 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:42.611843 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:42.611843 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:43.015772 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b318245e-284d-4675-b865-ea07c416e586 None None] [instance: 1ed891f3-7c51-4d5a-a71c-b81a64339bb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:43.242446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:43.608129 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:43.612193 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:43.621645 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:43.621645 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:43.628981 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:43.628981 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.638737 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.645745 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.651441 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:43.651441 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:43.651686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:43.651686 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:43.651813 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:33:43.651813 np0000000741 nova-compute[97948]: 
May 14 03:33:43.658489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:43.658489 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:43.658489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:33:43.658489 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:43.658489 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:33:43.658489 np0000000741 nova-compute[97948]: 
May 14 03:33:43.684074 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.40.100,3260]
May 14 03:33:43.684074 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.40.100,3260] successful.
May 14 03:33:43.684074 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.695892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.700389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.50.100,3260]
May 14 03:33:43.700389 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.50.100,3260] successful.
May 14 03:33:43.700389 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.707669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.707669 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.707669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:43.707912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.707912 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.707912 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:43.708024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:43.708113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:43.708683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('7', '-', '-', 0) found on session 9 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:43.708683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:43.713591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:43.724931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 9 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:43.725546 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.733561 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:43.733561 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('8', '-', '-', 0) found on session 10 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:43.733561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:43.766678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 10 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:43.766678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:44.572133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:33:44.988351 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:45.591100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Found WWN 3300000007724b52d for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:33:45.591386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:45.591574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000007724b52d', 'path': '/dev/dm-0', 'multipath_id': '3300000007724b52d'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:45.591734 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007724b52d', 'path': '/dev/dm-0', 'multipath_id': '3300000007724b52d'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:33:46.098086 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:33:46.098506 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:46.098633 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:46.099053 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:46.099301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:33:46.117689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:46.118985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:46.119515 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:46.120032 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:46.120321 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:46.120505 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:46.132695 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:46.132695 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:46.141459 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:46.141459 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f] added
May 14 03:33:46.152869 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:46.152869 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:46.152869 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:46.157406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f] added
May 14 03:33:46.157406 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:46.157406 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:46.157406 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:46.157406 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:46.157406 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:46.157406 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:46.157740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:46.157785 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:46.157955 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:46.230010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:47.154134 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:47.158449 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:47.176022 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:47.176022 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:47.191017 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:47.191017 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.196683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.214800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.216095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.216095 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.216095 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:47.216753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.216753 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.216753 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:47.227926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.227926 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.227926 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:47.228092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.228092 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.228092 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:47.249828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.40.100,3260]
May 14 03:33:47.249828 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.40.100,3260] successful.
May 14 03:33:47.249828 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.264000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.272608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.50.100,3260]
May 14 03:33:47.272608 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.50.100,3260] successful.
May 14 03:33:47.272608 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.280051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.280051 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.280051 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.280051 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.280051 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:47.280428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.280428 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.280428 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.280428 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.280428 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:47.280428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:47.280677 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:47.281151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('9', '-', '-', 0) found on session 11 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:47.281266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:47.287834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:47.303382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 11 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:47.303382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:47.308288 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('10', '-', '-', 0) found on session 12 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:47.308288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:47.326185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 12 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:47.326185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:47.618418 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005757789999734086 future=<Future at 0x79d0b071ca10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:47.618503 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:47.618848 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.072400176999963 future=<Future at 0x79d0b815ac90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:47.618848 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.072206964000088 future=<Future at 0x79d0b815ac90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:47.621260 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Emitting event <LifecycleEvent: 1778729612.6177535, 076a3e05-e920-470e-8cef-d7cc0bd1e580 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:47.621479 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] VM Stopped (Lifecycle Event)
May 14 03:33:48.120875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:33:48.126136 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 076a3e05-e920-470e-8cef-d7cc0bd1e580] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:48.244465 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:49.141240 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Found WWN 3300000006615fb08 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:33:49.141467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:49.141614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000006615fb08', 'path': '/dev/dm-3', 'multipath_id': '3300000006615fb08'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:49.141810 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006615fb08', 'path': '/dev/dm-3', 'multipath_id': '3300000006615fb08'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:33:49.646454 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:33:49.646943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:33:49.646943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:49.647199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:49.647421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:33:49.658262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:49.658989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:33:49.659460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:49.659792 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:49.660319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:33:49.660667 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:49.670983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:49.670983 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:49.675584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:33:49.675584 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:49.685936 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c] added
May 14 03:33:49.685936 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:49.685936 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:49.685936 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:49.685936 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:49.685936 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:49.685936 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:49.687276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:49.688106 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:49.688336 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:49.689232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c] added
May 14 03:33:49.689232 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:33:49.689232 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:49.689232 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:49.689232 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:33:49.689232 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:33:49.689232 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:49.689444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:33:49.689760 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:33:49.689919 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:33:50.587806 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:50.689395 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:33:50.690547 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:33:50.691366 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003098009999575879 future=<Future at 0x79d0b815ac90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:50.691434 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:33:50.691624 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778729615.6909704, 17280e5e-874d-407f-9a58-710dd3633f6b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:50.691763 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] VM Stopped (Lifecycle Event)
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:50.703278 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:50.703278 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:33:50.705858 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:33:50.705858 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.717807 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.718374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.733205 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:50.737986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.737986 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.737986 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.737986 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.737986 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:50.738270 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.738270 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.738270 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.738270 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.738270 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:50.765675 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.50.100,3260]
May 14 03:33:50.765675 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.50.100,3260] successful.
May 14 03:33:50.765675 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.773330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.40.100,3260]
May 14 03:33:50.773330 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.40.100,3260] successful.
May 14 03:33:50.773330 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.780771 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.786717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.794934 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.795115 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:50.795422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:50.795603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:50.796754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('11', '-', '-', 0) found on session 13 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:50.796920 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.806165 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:33:50.806372 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:33:50.806554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:50.806614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:33:50.807475 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] HCTL ('12', '-', '-', 0) found on session 14 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:33:50.807578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:33:50.816130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 13 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:50.816345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:50.823913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Searching for a device in session 14 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:33:50.823913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:33:51.196279 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2833aa50-666a-4549-9714-962efcdcbf1f None None] [instance: 17280e5e-874d-407f-9a58-710dd3633f6b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:51.231394 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:51.659899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:33:52.600794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:52.683293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Found WWN 3300000003c095387 for multipath device dm-4 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:33:52.683293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:33:52.683293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000003c095387', 'path': '/dev/dm-4', 'multipath_id': '3300000003c095387'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:33:52.683293 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c095387', 'path': '/dev/dm-4', 'multipath_id': '3300000003c095387'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:33:53.188888 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.189102 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.189725 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.190486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.190608 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.191412 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.195192 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.195505 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.196528 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.199038 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.199232 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.199818 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.200486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.200730 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.202896 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.204544 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.205208 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.205977 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.206782 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:33:53.206942 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.207279 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.208388 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lazy-loading 'pci_devices' on Instance uuid 32cb8438-d425-4069-84c9-35886e83c12d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:33:53.247414 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.711674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] End _get_guest_xml xml=<domain type="qemu">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <uuid>32cb8438-d425-4069-84c9-35886e83c12d</uuid>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <name>instance-00000008</name>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:name>tempest-device-tagging-server-677097887</nova:name>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:33:42</nova:creationTime>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:user uuid="018a70105e254d36b7ce8a3fe6bd973c">tempest-TaggedBootDevicesTest-787669211-project-member</nova:user>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:project uuid="3a911ae5ca594e7eb624869133cb0973">tempest-TaggedBootDevicesTest-787669211</nova:project>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="744344e1-b2f8-4495-89b2-9e5b882480bc">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="a48b3dfc-3d84-4ab7-b620-cebe09037d71">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="f74f34b2-c049-43f3-b870-a0c6f42ab0d2">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="a061b1c3-6cc7-4056-a432-29d76d3cfef0">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="7adb9002-2fb8-4c9e-85ad-7ffa01ce949a">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="aba7e22f-3355-445f-a830-c60dba6d8ae1">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         <nova:port uuid="b9f6fa62-7146-452e-a16c-ff2c8d82625c">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <system>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="serial">32cb8438-d425-4069-84c9-35886e83c12d</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="uuid">32cb8438-d425-4069-84c9-35886e83c12d</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </system>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <os>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </os>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <features>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </features>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   <devices>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/disk.config"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <alias name="ua-6d12ec63-80b5-44bc-a32e-991a977db826"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <serial>6d12ec63-80b5-44bc-a32e-991a977db826</serial>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <alias name="ua-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-3"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <serial>3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f</serial>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <alias name="ua-86362a6a-4ab1-452e-b99b-16c52823980c"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-4"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="vdc" bus="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <serial>86362a6a-4ab1-452e-b99b-16c52823980c</serial>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </disk>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5d:11:04"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tap744344e1-b2"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5f:09:2e"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tapa48b3dfc-3d"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:9b:29:ce"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tapf74f34b2-c0"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:d3:28:0d"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tapa061b1c3-6c"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:a4:89:1e"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tap7adb9002-2f"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:96:e2:b5"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tapaba7e22f-33"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3b:aa:63"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <target dev="tapb9f6fa62-71"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </interface>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/console.log" append="off"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </serial>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <video>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </video>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </rng>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:   </devices>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]: </domain>
May 14 03:33:53.711674 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.720365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Preparing to wait for external event network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.724106 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.724750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.724750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.724931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.725690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.725878 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c56ea1e2-56aa-5898-a4f4-7e7bfe83bfd0', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.728474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.729827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.733737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.733988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744344e1-b2, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.734456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap744344e1-b2, col_values=(('qos', UUID('fe7b2daf-54d3-45be-9a54-ae9ea5995207')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.734699 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap744344e1-b2, col_values=(('external_ids', {'iface-id': '744344e1-b2f8-4495-89b2-9e5b882480bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:11:04', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.736115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.736940 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.743542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.744787 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2')
May 14 03:33:53.745510 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.745720 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.746552 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.747305 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.747980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.747980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.748146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.748803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.748945 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '356ba223-0edd-5063-8d37-c27bcaeb60d1', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.751728 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.752571 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.758775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.761242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.761840 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa48b3dfc-3d, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.762966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa48b3dfc-3d, col_values=(('qos', UUID('82e13574-5bf1-4db9-b5fc-c2b99f9dba47')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.762966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa48b3dfc-3d, col_values=(('external_ids', {'iface-id': 'a48b3dfc-3d84-4ab7-b620-cebe09037d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:09:2e', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.765247 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.765319 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.779018 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.780233 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d')
May 14 03:33:53.781098 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.781283 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.781867 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.782456 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.782726 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.782860 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.783041 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.783856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.783992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '258e7937-224e-5c81-ad59-3248b48217f2', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.785373 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.785750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.797235 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.799174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.799333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf74f34b2-c0, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.799676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf74f34b2-c0, col_values=(('qos', UUID('e5616bbd-a851-4260-b20a-45af5c712b5d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.799819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf74f34b2-c0, col_values=(('external_ids', {'iface-id': 'f74f34b2-c049-43f3-b870-a0c6f42ab0d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:29:ce', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.801625 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.802547 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.820649 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.821626 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0')
May 14 03:33:53.822361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.822884 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.823393 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.823671 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.823895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.824088 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.824257 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.824990 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.825172 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35e60133-4daf-5b3d-a7c8-788a1b7ccbce', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.827069 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.827069 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.844135 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.847917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.848173 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa061b1c3-6c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.848613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa061b1c3-6c, col_values=(('qos', UUID('cbd28853-b6c0-40cd-a9c0-d53f43de5a63')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.849118 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa061b1c3-6c, col_values=(('external_ids', {'iface-id': 'a061b1c3-6cc7-4056-a432-29d76d3cfef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:28:0d', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.850093 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.851847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.877184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.878192 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c')
May 14 03:33:53.878908 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.879056 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.879544 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.880044 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.880269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.880630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.881324 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.882362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.882575 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9729b338-c6bb-5cf5-8e98-cc000b458517', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.884109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.884432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.910001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.911863 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.912073 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7adb9002-2f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.912852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7adb9002-2f, col_values=(('qos', UUID('9a57e6e7-1a53-444f-802b-ffe66492e62b')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.913003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7adb9002-2f, col_values=(('external_ids', {'iface-id': '7adb9002-2fb8-4c9e-85ad-7ffa01ce949a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:89:1e', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.914126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.915107 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.942112 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.944083 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f')
May 14 03:33:53.945677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:53.946019 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:53.946585 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:53.947317 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:53.949917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.950342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.950618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:53.954244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.954532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c08b951-8c61-59a3-afe0-7ea1ed390454', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:53.956308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:53.956308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:53.994621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.000896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.001178 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaba7e22f-33, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.001633 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaba7e22f-33, col_values=(('qos', UUID('1b2aebd8-5b8d-4b8f-a306-0e69c275ba96')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.001882 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaba7e22f-33, col_values=(('external_ids', {'iface-id': 'aba7e22f-3355-445f-a830-c60dba6d8ae1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e2:b5', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.003632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.005732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:54.043677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.044667 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33')
May 14 03:33:54.045542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:33:54.046408 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:33:54.047481 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:33:54.047876 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:33:54.048315 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.048697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.048823 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:33:54.050209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.050517 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c22cad3b-6715-515f-8941-59e2fea4a968', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.051670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.052312 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:54.086061 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.089037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.089313 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9f6fa62-71, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.089609 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9f6fa62-71, col_values=(('qos', UUID('0ae00e1f-dea5-4fe1-b69a-2ae40bc6a175')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.089801 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9f6fa62-71, col_values=(('external_ids', {'iface-id': 'b9f6fa62-7146-452e-a16c-ff2c8d82625c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:aa:63', 'vm-uuid': '32cb8438-d425-4069-84c9-35886e83c12d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:33:54.090935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.092286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:33:54.129765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:54.131475 np0000000741 nova-compute[97948]: INFO os_vif [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71')
May 14 03:33:55.657606 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:55.658170 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:33:55.658596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] No VIF found with MAC fa:16:3e:5d:11:04, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:55.659265 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] No VIF found with MAC fa:16:3e:a4:89:1e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:33:55.659981 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Using config drive
May 14 03:33:56.169019 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:33:56.369800 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Creating config drive at /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/disk.config
May 14 03:33:56.374461 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbmnokbw5 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:33:56.425519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbmnokbw5" returned: 0 in 0.051s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:33:56.958914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.021215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.026013 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.088160 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.125580 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.242975 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.268924 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b646953-cb28-4eba-a567-7fc97e79528a req-310fcf3e-60e0-4bd4-82fa-f393fab64784 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:57.272677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b646953-cb28-4eba-a567-7fc97e79528a req-310fcf3e-60e0-4bd4-82fa-f393fab64784 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:57.272677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b646953-cb28-4eba-a567-7fc97e79528a req-310fcf3e-60e0-4bd4-82fa-f393fab64784 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:57.272677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b646953-cb28-4eba-a567-7fc97e79528a req-310fcf3e-60e0-4bd4-82fa-f393fab64784 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:57.272677 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b646953-cb28-4eba-a567-7fc97e79528a req-310fcf3e-60e0-4bd4-82fa-f393fab64784 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:57.272677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.281808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.322766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.350062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.373660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.379015 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.419025 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.473091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.543381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.589326 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.721005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.794291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.801277 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.858532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.882997 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.887095 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:57.989408 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.081692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.083950 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.088491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.091548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.112986 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.251993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.432162 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.434875 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.591415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.595655 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.662226 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55422402-b782-485a-8b39-c1a0e0043618 req-a2572c35-a97d-4596-982a-7b13a527310b service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:58.662443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55422402-b782-485a-8b39-c1a0e0043618 req-a2572c35-a97d-4596-982a-7b13a527310b service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:58.664919 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55422402-b782-485a-8b39-c1a0e0043618 req-a2572c35-a97d-4596-982a-7b13a527310b service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:58.666673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55422402-b782-485a-8b39-c1a0e0043618 req-a2572c35-a97d-4596-982a-7b13a527310b service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:58.666673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55422402-b782-485a-8b39-c1a0e0043618 req-a2572c35-a97d-4596-982a-7b13a527310b service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:58.822128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:58.822128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.090785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.226583 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.233815 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.261993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.302510 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729639.3019874, 32cb8438-d425-4069-84c9-35886e83c12d => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:59.302803 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] VM Started (Lifecycle Event)
May 14 03:33:59.413016 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.415486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.415486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.415486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.415486 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc in dict_keys([('network-vif-plugged', 'a48b3dfc-3d84-4ab7-b620-cebe09037d71'), ('network-vif-plugged', 'f74f34b2-c049-43f3-b870-a0c6f42ab0d2'), ('network-vif-plugged', '7adb9002-2fb8-4c9e-85ad-7ffa01ce949a'), ('network-vif-plugged', 'aba7e22f-3355-445f-a830-c60dba6d8ae1'), ('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:59.415684 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-744344e1-b2f8-4495-89b2-9e5b882480bc for instance with vm_state building and task_state spawning.
May 14 03:33:59.415838 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.416011 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.416563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.416766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.416898 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:59.417029 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.417609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.417609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.417609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 in dict_keys([('network-vif-plugged', 'f74f34b2-c049-43f3-b870-a0c6f42ab0d2'), ('network-vif-plugged', '7adb9002-2fb8-4c9e-85ad-7ffa01ce949a'), ('network-vif-plugged', 'aba7e22f-3355-445f-a830-c60dba6d8ae1'), ('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-a48b3dfc-3d84-4ab7-b620-cebe09037d71 for instance with vm_state building and task_state spawning.
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.418995 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 in dict_keys([('network-vif-plugged', '7adb9002-2fb8-4c9e-85ad-7ffa01ce949a'), ('network-vif-plugged', 'aba7e22f-3355-445f-a830-c60dba6d8ae1'), ('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-f74f34b2-c049-43f3-b870-a0c6f42ab0d2 for instance with vm_state building and task_state spawning.
May 14 03:33:59.419908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:33:59.420250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.420250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.420315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:33:59.420401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cb3ffbb5-b6ce-4ba8-9227-04f0e097455d req-eb5f0018-4c72-4ea2-ba3f-2914f7474b9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:33:59.550678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.551786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:33:59.774576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:33:59.774576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:33:59.807896 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:33:59.811097 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729639.810759, 32cb8438-d425-4069-84c9-35886e83c12d => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:33:59.811492 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] VM Paused (Lifecycle Event)
May 14 03:34:00.276156 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:34:00.317603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:00.319079 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:00.741656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:00.742811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:00.743143 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:00.743507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:00.743702 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 in dict_keys([('network-vif-plugged', '7adb9002-2fb8-4c9e-85ad-7ffa01ce949a'), ('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:34:00.743856 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 for instance with vm_state building and task_state spawning.
May 14 03:34:00.743963 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:00.744697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:00.745169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:00.745347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:00.745550 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:34:00.745773 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:00.746039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:00.746130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:00.746223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:00.746350 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a in dict_keys([('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:34:00.746470 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d1e202bc-926e-4c8d-b971-7bcd3efe179c req-b84688ba-e806-4959-9381-ed9654140e1f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a for instance with vm_state building and task_state spawning.
May 14 03:34:00.824854 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:00.844431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:00.845304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:00.849187 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:34:00.849324 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Claim successful on node np0000000741
May 14 03:34:01.484097 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:01.484700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:01.484828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:01.484981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:01.485173 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No event matching network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 in dict_keys([('network-vif-plugged', 'b9f6fa62-7146-452e-a16c-ff2c8d82625c')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:34:01.485331 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-aba7e22f-3355-445f-a830-c60dba6d8ae1 for instance with vm_state building and task_state spawning.
May 14 03:34:01.485529 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:01.485667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:01.485860 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:01.485985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:01.486163 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Processing event network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:34:01.486343 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:01.486608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:01.487835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:01.487835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:01.488246 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:34:01.492710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:01.492710 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2143aa72-d316-4554-b93b-5920061da645 req-1415086a-44c4-4b82-937e-2ad42ce5c779 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received unexpected event network-vif-plugged-b9f6fa62-7146-452e-a16c-ff2c8d82625c for instance with vm_state building and task_state spawning.
May 14 03:34:01.492710 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:34:01.492710 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729641.4918716, 32cb8438-d425-4069-84c9-35886e83c12d => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:01.492710 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] VM Resumed (Lifecycle Event)
May 14 03:34:01.495220 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance spawned successfully.
May 14 03:34:01.495530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:34:01.808711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:01.808934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:01.929590 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:01.932468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:01.994946 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:02.000295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:02.011182 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.011334 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.011734 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.014203 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.014974 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.016046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:02.312774 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lazy-loading 'flavor' on Instance uuid ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:02.376479 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:02.376752 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:02.439326 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lazy-loading 'flavor' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:02.505516 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:02.526738 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Took 33.17 seconds to spawn the instance on the hypervisor.
May 14 03:34:02.526866 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:02.879670 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:03.043111 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Took 48.91 seconds to build instance.
May 14 03:34:03.254182 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:03.319165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:03.386993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.542s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:03.387231 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:34:03.444753 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:03.545376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a2741eeb-24ea-4ebd-93ae-f5cbe0981864 tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.435s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:03.894081 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:34:03.894391 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:34:03.895031 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:03.895487 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:04.009294 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2014044c024e0891b86095ab736fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c875214b84942f4b242e6a4213ba7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:34:04.101548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:04.399394 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:34:04.577210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:04.577765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:04.578010 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Attaching volume a4948ef2-b700-41ea-a9fb-d17a7426bdf9 to /dev/vdb
May 14 03:34:04.641474 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:04.655826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:34:04.680356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:04.719103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:34:04.719846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:34:04.733516 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Successfully created port: 85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:34:04.738816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:34:04.741138 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a', 'fe80::fc16:3eff:fe5d:1104', 'fe80::20af:60ff:fe2b:e842', 'fe80::fc16:3eff:fe5f:92e', 'fe80::fc16:3eff:fe9b:29ce', 'fe80::fc16:3eff:fed3:280d', 'fe80::fc16:3eff:fea4:891e', 'fe80::fc16:3eff:fe96:e2b5', 'fe80::64f7:dff:fe73:777d', 'fe80::fc16:3eff:fe3b:aa63', 'fe80::acd3:9bff:fea1:18bc'] 
May 14 03:34:04.741314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:34:04.744725 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:34:04.744725 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:04.744725 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating existing volume attachment record: 49d9f28b-477d-4154-8518-9431d944e97a {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:34:04.897662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:04.897662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:04.897662 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Attaching volume 00f08aa7-480c-49c2-80d9-ae6bf0f5267b to /dev/sdc
May 14 03:34:04.904161 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:34:04.915593 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-changed-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:04.915873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing instance network info cache due to event network-changed-744344e1-b2f8-4495-89b2-9e5b882480bc. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:04.916032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] Acquiring lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:04.916580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] Acquired lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:04.918726 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Refreshing network info cache for port 744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:04.972970 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:04.984225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:34:05.006599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:05.033713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:34:05.034174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:34:05.050836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:34:05.052714 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a', 'fe80::fc16:3eff:fe5d:1104', 'fe80::20af:60ff:fe2b:e842', 'fe80::fc16:3eff:fe5f:92e', 'fe80::fc16:3eff:fe9b:29ce', 'fe80::fc16:3eff:fed3:280d', 'fe80::fc16:3eff:fea4:891e', 'fe80::fc16:3eff:fe96:e2b5', 'fe80::64f7:dff:fe73:777d', 'fe80::fc16:3eff:fe3b:aa63', 'fe80::acd3:9bff:fea1:18bc'] 
May 14 03:34:05.052844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:34:05.053010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:34:05.053289 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:05.053577 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating existing volume attachment record: d7a38d7b-7576-4740-91b3-fce4d19740e3 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:34:05.326858 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:34:05.328108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:05.328108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:05.328108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:05.328330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:34:05.344426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:05.344839 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:05.345027 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:05.345608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:05.348384 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:05.348384 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:05.360093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:05.360093 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:05.360848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:05.360848 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9] added
May 14 03:34:05.374629 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:05.374629 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:05.374629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:05.375018 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:05.375018 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:05.386663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9] added
May 14 03:34:05.386663 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:05.386663 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:05.386663 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:05.386663 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:05.386663 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:05.386663 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:05.387036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:05.387203 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:05.387392 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:05.415871 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Booting with volume f4f4fe53-19a1-4009-b32b-4dc114f19b52 at /dev/vda
May 14 03:34:05.423754 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:05.475442 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Successfully updated port: 85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:34:05.479936 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:05.498536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:34:05.526708 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:05.558616 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-changed-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:05.566484 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Refreshing instance network info cache due to event network-changed-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:05.567552 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:34:05.567844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] Acquiring lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:05.568123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:34:05.568772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] Acquired lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:05.568915 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Refreshing network info cache for port 85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:05.578992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:34:05.580514 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a', 'fe80::fc16:3eff:fe5d:1104', 'fe80::20af:60ff:fe2b:e842', 'fe80::fc16:3eff:fe5f:92e', 'fe80::fc16:3eff:fe9b:29ce', 'fe80::fc16:3eff:fed3:280d', 'fe80::fc16:3eff:fea4:891e', 'fe80::fc16:3eff:fe96:e2b5', 'fe80::64f7:dff:fe73:777d', 'fe80::fc16:3eff:fe3b:aa63', 'fe80::acd3:9bff:fea1:18bc'] 
May 14 03:34:05.580634 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:34:05.580789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:34:05.581159 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:05.582723 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating existing volume attachment record: 6f7d51cf-b4b0-4be6-b279-1a1551e47d67 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:34:05.633812 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:34:05.634241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:05.635148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:05.859589 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:05.985089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:06.001116 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updated VIF entry in instance network info cache for port 744344e1-b2f8-4495-89b2-9e5b882480bc. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:34:06.003094 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:06.072333 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:06.174083 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:06.373609 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:06.376141 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:06.387455 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:06.387455 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.390173 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:06.399832 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:06.399832 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.406136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.411682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.423188 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.423469 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.431670 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:06.462580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.40.100,3260]
May 14 03:34:06.462580 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.40.100,3260] successful.
May 14 03:34:06.462580 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.473454 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.480973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.50.100,3260]
May 14 03:34:06.480973 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.50.100,3260] successful.
May 14 03:34:06.480973 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.494277 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:06.494666 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:06.494796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:06.495991 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] HCTL ('13', '-', '-', 0) found on session 15 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:06.496151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:06.501973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:06.504847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68bbef93-de3e-467b-85a9-38ae7235def5 req-d577204f-9a84-4b9a-9b0c-f72ec3e5373d service nova] Releasing lock "refresh_cache-32cb8438-d425-4069-84c9-35886e83c12d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:06.514224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Searching for a device in session 15 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:06.514369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.519413 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:06.520952 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] HCTL ('14', '-', '-', 0) found on session 16 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:06.520952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:06.537976 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Searching for a device in session 16 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:06.538169 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:06.875334 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c3aa7eed-ef53-42ac-b719-cb3ef0abb6d2 req-22bc8046-dde5-4729-b6b1-b2df926a81ce service nova] Releasing lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:06.876111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquired lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:06.876228 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:34:07.347805 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:34:07.485007 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:07.675612 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:07.719631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:34:07.720975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:34:07.721166 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating image(s)
May 14 03:34:07.721453 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:34:07.721565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Ensure instance console log exists: /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:34:07.722065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:07.722266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:07.722710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:07.848946 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating instance_info_cache with network_info: [{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:08.253694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:08.351363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Releasing lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:08.351497 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance network_info: |[{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:34:08.352415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start _get_guest_xml network_info=[{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7ff50ead-8117-44fd-9be6-8ac88fa1f76d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'serial': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52'}, 'boot_index': 0, 'attachment_id': '6f7d51cf-b4b0-4be6-b279-1a1551e47d67', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:34:08.357365 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:34:08.360034 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1695037310', uuid='7ff50ead-8117-44fd-9be6-8ac88fa1f76d'), owner=OwnerMeta(userid='4c2014044c024e0891b86095ab736fc1', username='tempest-ServerActionsV293TestJSON-1469734157-project-member', projectid='2c875214b84942f4b242e6a4213ba7ff', projectname='tempest-ServerActionsV293TestJSON-1469734157'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729648.3596015) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:34:08.364590 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:34:08.365223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:34:08.367304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Found WWN 33000000023370ad8 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:34:08.367794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:08.368159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000023370ad8', 'path': '/dev/dm-5', 'multipath_id': '33000000023370ad8'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:08.368247 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000023370ad8', 'path': '/dev/dm-5', 'multipath_id': '33000000023370ad8'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:34:08.368837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.734s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:08.369126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:34:08.369631 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:34:08.369942 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:34:08.371754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:34:08.372180 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:34:08.372393 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:34:08.372537 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:34:08.372818 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:34:08.372896 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:34:08.373062 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:34:08.373265 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:34:08.373424 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:34:08.373591 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:34:08.376258 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:34:08.376658 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:34:08.395086 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lazy-loading 'flavor' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:08.398048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:08.398863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:08.399483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:08.399830 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:08.400395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:08.400495 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:08.403189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:34:08.403465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:08.403994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:08.414027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:08.414027 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:08.420048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:08.420048 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b] added
May 14 03:34:08.430008 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:08.430008 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:08.430008 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:08.434888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b] added
May 14 03:34:08.434888 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:08.434888 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:08.434888 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:08.434888 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:08.434888 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:08.434888 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:08.435149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:08.435186 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:08.435345 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:08.902523 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Attempting to attach volume a4948ef2-b700-41ea-a9fb-d17a7426bdf9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:34:08.903799 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] attach device xml: <disk type="block" device="disk">
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:   <alias name="ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9"/>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:   <serial>a4948ef2-b700-41ea-a9fb-d17a7426bdf9</serial>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:08.903799 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:34:09.103337 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:09.430497 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:09.435862 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:09.441058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:09.441295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing instance network info cache due to event network-changed-d5cff4c1-8912-41dc-97c5-aa9ad87391c5. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:09.441439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] Acquiring lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:09.441500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] Acquired lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:09.441771 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Refreshing network info cache for port d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:09.444686 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:09.444686 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:09.452406 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:09.452406 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.459781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.466138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.474909 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.475244 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.487314 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.487684 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:09.525779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.40.100,3260]
May 14 03:34:09.525779 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.40.100,3260] successful.
May 14 03:34:09.525779 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.535215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.551351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.50.100,3260]
May 14 03:34:09.551351 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.50.100,3260] successful.
May 14 03:34:09.551351 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.554470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] HCTL ('15', '-', '-', 0) found on session 17 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:09.554470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:09.563379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:09.581990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Searching for a device in session 17 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:09.581990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.592354 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:09.593039 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:09.593039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:09.593799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] HCTL ('16', '-', '-', 0) found on session 18 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:09.593928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:09.617273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Searching for a device in session 18 and hctl ['16', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:09.945769 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:10.295275 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:10.316965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:10.317187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:10.434496 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updated VIF entry in instance network info cache for port d5cff4c1-8912-41dc-97c5-aa9ad87391c5. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:34:10.436473 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [{"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:10.577896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:10.577896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:10.577896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:10.578044 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] No VIF found with MAC fa:16:3e:73:88:9e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:10.617896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Searching for a device in session 18 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:10.618040 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:10.823164 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:10.937922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7f7d32c-09dc-424b-8be9-76049d5d26ef req-f75886a8-7afd-4b1b-922e-5481a4200f2f service nova] Releasing lock "refresh_cache-c3ced606-f7f2-4b81-974d-4c064e3801d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:11.418648 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Found WWN 33000000086f7ac2d for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:34:11.419010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:11.419242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] <== connect_volume: return (5784ms) {'type': 'block', 'scsi_wwn': '33000000086f7ac2d', 'path': '/dev/dm-6', 'multipath_id': '33000000086f7ac2d'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:11.419558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086f7ac2d', 'path': '/dev/dm-6', 'multipath_id': '33000000086f7ac2d'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:34:11.420247 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.016s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:11.420589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:34:11.423415 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lazy-loading 'flavor' on Instance uuid ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:11.433262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:11.434455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:11.435325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:11.435822 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:11.436113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:11.436484 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:11.449554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:11.449554 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:11.455771 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:11.455771 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:11.465412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52] added
May 14 03:34:11.465412 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:11.465412 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:11.465412 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:11.465412 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:11.465412 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:11.465412 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:11.465660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:11.465728 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:11.465880 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:11.467860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52] added
May 14 03:34:11.467860 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:11.467860 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:11.467860 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:11.467860 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:11.467860 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:11.467860 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:11.468040 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:11.468137 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:11.468243 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:11.500298 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-changed-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:11.500298 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Refreshing instance network info cache due to event network-changed-c089441d-bae2-4d49-a901-db7d9bc95f20. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:11.500298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] Acquiring lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:11.500298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] Acquired lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:11.500298 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Refreshing network info cache for port c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:11.828262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:11.927286 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <alias name="ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b"/>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <target dev="sdc" bus="scsi"/>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <serial>00f08aa7-480c-49c2-80d9-ae6bf0f5267b</serial>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:   <address type="drive" controller="0" unit="2"/>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:11.927286 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:34:12.002151 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:12.130165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7092a65f-64c8-48f6-91f1-cf14ece016f8 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.553s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:12.153067 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] volume_snapshot_create: create_info: {'snapshot_id': '2419ece6-40ae-4e38-886b-98be639a327d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=97948) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 14 03:34:12.157096 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] snap xml: <domainsnapshot>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:   <disks>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:     <disk name="/dev/dm-5" snapshot="external" type="file">
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:       <source file="/dev/new_file"/>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:     <disk name="vda" snapshot="no"/>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:     <disk name="hda" snapshot="no"/>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:   </disks>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]: </domainsnapshot>
May 14 03:34:12.157096 np0000000741 nova-compute[97948]:  {{(pid=97948) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 14 03:34:12.157330 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] Lazy-loading 'system_metadata' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:12.202870 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2aa16029-c9ec-49c6-ba47-248ed854a0c0 tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] volume_snapshot_delete: delete_info: {'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9'} {{(pid=97948) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [None req-2aa16029-c9ec-49c6-ba47-248ed854a0c0 tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Traceback (most recent call last):
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     self._volume_snapshot_delete(context, instance, volume_id,
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     if delete_info['type'] != 'qcow2':
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]        ~~~~~~~~~~~^^^^^^^^
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] KeyError: 'type'
May 14 03:34:12.203811 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] 
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [None req-2aa16029-c9ec-49c6-ba47-248ed854a0c0 tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-61808f37-90fa-4fec-9946-2de4be7304dd)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 14 03:34:12.242493 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server [None req-2aa16029-c9ec-49c6-ba47-248ed854a0c0 tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] Exception during message handling: KeyError: 'type'
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 14 03:34:12.247216 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server 
May 14 03:34:12.380067 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:12.466433 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:12.468868 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:12.479737 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:12.479737 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:12.490669 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:12.490669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.498526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.499863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.516694 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.517110 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.522525 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.523167 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:12.537476 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updated VIF entry in instance network info cache for port c089441d-bae2-4d49-a901-db7d9bc95f20. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:34:12.537767 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updating instance_info_cache with network_info: [{"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:12.562491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260]
May 14 03:34:12.562491 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260] successful.
May 14 03:34:12.562491 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.573929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.579327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260]
May 14 03:34:12.579327 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260] successful.
May 14 03:34:12.579327 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.591595 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.591999 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:12.591999 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:12.592272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:12.593262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] HCTL ('17', '-', '-', 0) found on session 19 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:12.593741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:12.598629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:12.611076 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching for a device in session 19 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:12.611299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.625913 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:12.626382 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:12.626382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:12.626933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:12.627688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] HCTL ('18', '-', '-', 0) found on session 20 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:12.627930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:12.648399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching for a device in session 20 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:12.648399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:12.661368 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Traceback (most recent call last):
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.669474 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] 
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Traceback (most recent call last):
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     self._volume_snapshot_create(context, instance, guest,
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.670290 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [instance: f444aa34-be20-4e14-acd9-19c487ab903f] 
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2419ece6-40ae-4e38-886b-98be639a327d could not be found.
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2419ece6-40ae-4e38-886b-98be639a327d could not be found. (HTTP 404) (Request-ID: req-222b1baf-c222-4272-9e34-32c928473d95)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2419ece6-40ae-4e38-886b-98be639a327d could not be found.
May 14 03:34:12.697057 np0000000741 nova-compute[97948]: ERROR nova.virt.libvirt.driver 
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server [None req-3c466a91-6672-4b8f-a11a-da288de476be tempest-VolumesAssistedSnapshotsTest-1304224945 tempest-VolumesAssistedSnapshotsTest-1304224945-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 03:34:12.703387 np0000000741 nova-compute[97948]: ERROR oslo_messaging.rpc.server 
May 14 03:34:12.937546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:12.937755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:13.041058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0b918cd2-5194-41e1-8576-ccc96774b5e7 req-68cf8508-d433-4a79-9714-c236ba7c10d7 service nova] Releasing lock "refresh_cache-c2f3a900-f95f-44ca-832c-117a1239d831" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:13.255415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:13.437891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:34:13.440847 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Detaching volume a4948ef2-b700-41ea-a9fb-d17a7426bdf9
May 14 03:34:13.471248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:13.471751 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:13.471751 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Attaching volume 8623c897-9970-4f9a-90b7-d87adee3fe00 to /dev/vdb
May 14 03:34:13.502715 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Attempting to driver detach volume a4948ef2-b700-41ea-a9fb-d17a7426bdf9 from mountpoint /dev/vdb
May 14 03:34:13.508859 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Found disk vdb by alias ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:13.514745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Found disk vdb by alias ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:13.514745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Attempting to detach device vdb from instance f444aa34-be20-4e14-acd9-19c487ab903f from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:34:13.514745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] detach device xml: <disk type="block" device="disk">
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <alias name="ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9"/>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <serial>a4948ef2-b700-41ea-a9fb-d17a7426bdf9</serial>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:13.514745 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:13.522297 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Successfully detached device vdb from instance f444aa34-be20-4e14-acd9-19c487ab903f from the persistent domain config.
May 14 03:34:13.522524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] (1/8): Attempting to detach device vdb with device alias ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 from instance f444aa34-be20-4e14-acd9-19c487ab903f from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:34:13.522830 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] detach device xml: <disk type="block" device="disk">
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <alias name="ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9"/>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <serial>a4948ef2-b700-41ea-a9fb-d17a7426bdf9</serial>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:13.522830 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:13.532780 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:13.547103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:34:13.569366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:13.601265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:34:13.601667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:34:13.615209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:34:13.618698 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe86:fd94', 'fe80::8c90:c7ff:fee5:4668', 'fe80::fc16:3eff:fe73:889e', 'fe80::508d:fbff:fe45:e21b', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a', 'fe80::fc16:3eff:fe5d:1104', 'fe80::20af:60ff:fe2b:e842', 'fe80::fc16:3eff:fe5f:92e', 'fe80::fc16:3eff:fe9b:29ce', 'fe80::fc16:3eff:fed3:280d', 'fe80::fc16:3eff:fea4:891e', 'fe80::fc16:3eff:fe96:e2b5', 'fe80::64f7:dff:fe73:777d', 'fe80::fc16:3eff:fe3b:aa63', 'fe80::acd3:9bff:fea1:18bc'] 
May 14 03:34:13.618698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:34:13.618925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:34:13.619173 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:13.619445 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updating existing volume attachment record: f089ad3c-826e-459c-b7fa-3a754b13b38b {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:34:13.641193 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No BDM found with device name sda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:13.641381 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:13.641586 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No BDM found with device name sdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:13.641690 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] No VIF found with MAC fa:16:3e:86:fd:94, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:14.104552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:14.106582 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729654.1056108, f444aa34-be20-4e14-acd9-19c487ab903f => ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:34:14.107170 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 for instance f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:34:14.110409 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Successfully detached device vdb from instance f444aa34-be20-4e14-acd9-19c487ab903f from the live domain config.
May 14 03:34:14.111607 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:14.111974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:14.112265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:14.172967 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:34:14.173299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:14.173455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:14.453895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Found WWN 3300000004fd344d4 for multipath device dm-7 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:34:14.454355 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:14.455051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:14.455545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== connect_volume: return (6051ms) {'type': 'block', 'scsi_wwn': '3300000004fd344d4', 'path': '/dev/dm-7', 'multipath_id': '3300000004fd344d4'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:14.455824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:14.455996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:14.456317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004fd344d4', 'path': '/dev/dm-7', 'multipath_id': '3300000004fd344d4'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:14.483422 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:14.484054 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '9')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:14.484054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', '15')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:14.484989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9', '16')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:14.487130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0720680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'): ({'sdi'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:14.487345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:14.489323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Flush multipath device 33000000023370ad8 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:14.520609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:14.567063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:14.618057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:14.618225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:14.619572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:14.631218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:14.631395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:14.641705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.684291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.40.100,3260]
May 14 03:34:14.684291 np0000000741 nova-compute[97948]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.40.100,3260] successful.
May 14 03:34:14.684291 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.706064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.719925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.768214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.50.100,3260]
May 14 03:34:14.768214 np0000000741 nova-compute[97948]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-a4948ef2-b700-41ea-a9fb-d17a7426bdf9, portal: 192.168.50.100,3260] successful.
May 14 03:34:14.768214 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.793036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.793255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:14.793398 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] <== disconnect_volume: return (681ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:14.793560 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:14.795754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.622s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:14.797578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:34:14.812240 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:14.813615 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:14.813994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:14.814238 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:14.815137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:14.815137 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:14.827175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:14.827175 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.837979 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:34:14.837979 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00] added
May 14 03:34:14.843950 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:14.843950 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.843950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:14.844599 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:14.844865 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:14.853079 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00] added
May 14 03:34:14.853079 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:34:14.853079 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:14.853079 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:14.853079 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:34:14.853079 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:34:14.853079 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:14.853486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:34:14.853896 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:34:14.854157 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:34:14.960995 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1695037310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:34:14.961208 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:14.962028 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:14.962968 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ff50ead-8117-44fd-9be6-8ac88fa1f76d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:15.209548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13305a97-ad62-4706-a5c5-e77d186aafad tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.314s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:15.363489 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lazy-loading 'flavor' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:15.467147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] End _get_guest_xml xml=<domain type="qemu">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <uuid>7ff50ead-8117-44fd-9be6-8ac88fa1f76d</uuid>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <name>instance-00000009</name>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1695037310</nova:name>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:34:08</nova:creationTime>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:user uuid="4c2014044c024e0891b86095ab736fc1">tempest-ServerActionsV293TestJSON-1469734157-project-member</nova:user>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:project uuid="2c875214b84942f4b242e6a4213ba7ff">tempest-ServerActionsV293TestJSON-1469734157</nova:project>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         <nova:port uuid="85ebf74d-7491-40f6-8d0b-502c1e3b6e7d">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <system>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="serial">7ff50ead-8117-44fd-9be6-8ac88fa1f76d</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="uuid">7ff50ead-8117-44fd-9be6-8ac88fa1f76d</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </system>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <os>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </os>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <features>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </features>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   <devices>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <alias name="ua-f4f4fe53-19a1-4009-b32b-4dc114f19b52"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-7"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <serial>f4f4fe53-19a1-4009-b32b-4dc114f19b52</serial>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b5:d8:92"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <target dev="tap85ebf74d-74"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </interface>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/console.log" append="off"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </serial>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <video>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </video>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </rng>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:   </devices>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]: </domain>
May 14 03:34:15.467147 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Preparing to wait for external event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1695037310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:34:15.469224 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:15.469578 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:15.469830 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:34:15.470796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.470936 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:15.471293 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:34:15.473918 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.474121 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f8e8365-0aac-5a5e-b1cf-be6166c65601', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:15.475941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.478425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:15.483877 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.484336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ebf74d-74, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:15.484472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ebf74d-74, col_values=(('qos', UUID('879d442e-0eb6-4c18-be71-99430994413a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:15.484760 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ebf74d-74, col_values=(('external_ids', {'iface-id': '85ebf74d-7491-40f6-8d0b-502c1e3b6e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:d8:92', 'vm-uuid': '7ff50ead-8117-44fd-9be6-8ac88fa1f76d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:15.485664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.487107 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:15.491992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:15.493304 np0000000741 nova-compute[97948]: INFO os_vif [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74')
May 14 03:34:15.845289 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:15.854760 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:15.860973 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:15.860973 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:15.873279 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:15.873279 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.883380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.893768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.902439 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.902792 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.914796 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:15.915241 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:15.973316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.40.100,3260]
May 14 03:34:15.973316 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.40.100,3260] successful.
May 14 03:34:15.973316 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.973961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.50.100,3260]
May 14 03:34:15.973961 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.50.100,3260] successful.
May 14 03:34:15.973961 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.986060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:15.999197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.014002 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.014481 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:16.014822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:16.014822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:16.020082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] HCTL ('13', '-', '-', 0) found on session 21 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:16.020215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.021923 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:16.022229 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:16.022621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:16.022902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:16.024486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] HCTL ('14', '-', '-', 0) found on session 22 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:16.024590 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:16.043854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching for a device in session 21 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:16.044026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:16.055322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching for a device in session 22 and hctl ['14', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:16.261453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:16.261720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:16.370344 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-50dbc572-185a-4b6f-8824-ca65fda954c4 tempest-VolumesAssistedSnapshotsTest-184802642 tempest-VolumesAssistedSnapshotsTest-184802642-project-admin] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.432s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:16.764043 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Detaching volume 00f08aa7-480c-49c2-80d9-ae6bf0f5267b
May 14 03:34:16.809478 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Attempting to driver detach volume 00f08aa7-480c-49c2-80d9-ae6bf0f5267b from mountpoint /dev/sdc
May 14 03:34:16.814138 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Found disk sdc by alias ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:16.814912 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Found disk sdc by alias ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:16.815036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Attempting to detach device sdc from instance ed521445-93a9-42d1-bd32-da5d03ecfe95 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:34:16.815255 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <alias name="ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b"/>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <target dev="sdc" bus="scsi"/>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <serial>00f08aa7-480c-49c2-80d9-ae6bf0f5267b</serial>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:16.815255 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:16.822335 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Successfully detached device sdc from instance ed521445-93a9-42d1-bd32-da5d03ecfe95 from the persistent domain config.
May 14 03:34:16.822502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] (1/8): Attempting to detach device sdc with device alias ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b from instance ed521445-93a9-42d1-bd32-da5d03ecfe95 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:34:16.823945 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <alias name="ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b"/>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <target dev="sdc" bus="scsi"/>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <serial>00f08aa7-480c-49c2-80d9-ae6bf0f5267b</serial>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:16.823945 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:16.994975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729656.994535, ed521445-93a9-42d1-bd32-da5d03ecfe95 => ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:34:16.996384 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-00f08aa7-480c-49c2-80d9-ae6bf0f5267b for instance ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:34:16.999436 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Successfully detached device sdc from instance ed521445-93a9-42d1-bd32-da5d03ecfe95 from the live domain config.
May 14 03:34:17.000629 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:17.000629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:17.000629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:17.014136 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:17.014269 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:17.014397 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No VIF found with MAC fa:16:3e:b5:d8:92, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:17.014861 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Using config drive
May 14 03:34:17.053972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching for a device in session 22 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:17.054235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:17.521022 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:17.645866 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating config drive at /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config
May 14 03:34:17.650956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdwst5lby {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:17.695431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdwst5lby" returned: 0 in 0.044s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:17.834352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found WWN 3300000004e197c3e for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:34:17.834352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:17.834352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] <== connect_volume: return (3659ms) {'type': 'block', 'scsi_wwn': '3300000004e197c3e', 'path': '/dev/dm-5', 'multipath_id': '3300000004e197c3e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:17.834352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004e197c3e', 'path': '/dev/dm-5', 'multipath_id': '3300000004e197c3e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:34:17.838354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.836s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:17.838354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:17.838354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:17.838354 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:17.889460 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '9')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '17')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b', '18')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:17.889460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b07214e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'): ({'sdk'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:17.891827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Removing multipathed devices sdj, sdk {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:17.892554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Flush multipath device 33000000086f7ac2d {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:17.939849 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:17.981000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:18.032225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:18.032430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:18.037578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:18.056016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:18.056134 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:18.067942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.124950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.40.100,3260]
May 14 03:34:18.124950 np0000000741 nova-compute[97948]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.40.100,3260] successful.
May 14 03:34:18.124950 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.149415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.161967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.194306 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.206749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.50.100,3260]
May 14 03:34:18.206749 np0000000741 nova-compute[97948]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-00f08aa7-480c-49c2-80d9-ae6bf0f5267b, portal: 192.168.50.100,3260] successful.
May 14 03:34:18.206749 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.225404 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.229356 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.239706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:18.239706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:18.239706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] <== disconnect_volume: return (1237ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:18.239706 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:18.257611 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.333123 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.345965 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Attempting to attach volume 8623c897-9970-4f9a-90b7-d87adee3fe00 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:34:18.348589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:18.348589 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:34:18.423128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:18.423387 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:18.423613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:18.425256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:18.425256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:18.427275 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Terminating instance
May 14 03:34:18.433734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-135be56c-3581-4cc1-9de6-022313cfe76a req-7f8acd2d-3920-40ca-a98f-e3f8ea07e43a service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:18.436262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-135be56c-3581-4cc1-9de6-022313cfe76a req-7f8acd2d-3920-40ca-a98f-e3f8ea07e43a service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:18.436932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-135be56c-3581-4cc1-9de6-022313cfe76a req-7f8acd2d-3920-40ca-a98f-e3f8ea07e43a service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:18.436932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-135be56c-3581-4cc1-9de6-022313cfe76a req-7f8acd2d-3920-40ca-a98f-e3f8ea07e43a service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:18.436932 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-135be56c-3581-4cc1-9de6-022313cfe76a req-7f8acd2d-3920-40ca-a98f-e3f8ea07e43a service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Processing event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:34:18.575776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.584327 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.612695 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.823928 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lazy-loading 'flavor' on Instance uuid ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:18.936586 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:18.964370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.965794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.989369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:18.994051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.027925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.285610 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999687748000042 future=<Future at 0x79d0b0742b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:19.285914 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999337788000048 future=<Future at 0x79d0b0742b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:19.286010 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999232785999993 future=<Future at 0x79d0b0742b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:19.291556 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Instance destroyed successfully.
May 14 03:34:19.292051 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lazy-loading 'resources' on Instance uuid f444aa34-be20-4e14-acd9-19c487ab903f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:19.383916 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729659.3798282, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:19.384346 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:34:19.384559 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Started (Lifecycle Event)
May 14 03:34:19.387340 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:34:19.393031 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance spawned successfully.
May 14 03:34:19.393542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:34:19.575360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:19.575360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:19.578669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:19.578669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No VIF found with MAC fa:16:3e:45:af:c5, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:19.795379 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-266585382',display_name='tempest-VolumesAssistedSnapshotsTest-server-266585382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesassistedsnapshotstest-server-266585382',id=5,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvP4Qn2q7ltKLHrI6Q/OwekbecQ4F6ipIQSptt49HOaSkjD/NNG3s4UIy2AQ/QziHt1yhIE/LIRq5YEuRbH6I9SCBHHVjaHboHn5EU/s3UpHaULWDWaVZ+XRuTDMDNEsw==',key_name='tempest-keypair-251811921',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:22Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83195f6b3c514bc5b4441b6ede42e72e',ramdisk_id='',reservation_id='r-v44vw9ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-157421557',owner_user_name='tempest-VolumesAssistedSnapshotsTest-157421557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9171624056948e9898538cd5b0e0f9b',uuid=f444aa34-be20-4e14-acd9-19c487ab903f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:19.795576 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converting VIF {"id": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "address": "fa:16:3e:73:88:9e", "network": {"id": "59d785de-c027-4d73-b408-85b93cdd0f1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1074325622-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83195f6b3c514bc5b4441b6ede42e72e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape571c1f8-0f", "ovs_interfaceid": "e571c1f8-0f1f-4c5d-9b08-4fe2020002cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:19.796287 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:19.796877 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:19.801188 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.801188 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape571c1f8-0f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:19.807957 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.809073 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:19.812703 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.814884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.814884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2d58b8a-7843-428b-ab6f-9c2c792c2e2b) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:19.814884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.815447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:19.818062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:19.825001 np0000000741 nova-compute[97948]: INFO os_vif [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:9e,bridge_name='br-int',has_traffic_filtering=True,id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb,network=Network(59d785de-c027-4d73-b408-85b93cdd0f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape571c1f8-0f')
May 14 03:34:19.825001 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Deleting instance files /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f_del
May 14 03:34:19.828389 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Deletion of /opt/stack/data/nova/instances/f444aa34-be20-4e14-acd9-19c487ab903f_del complete
May 14 03:34:19.833235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd628013-a353-415c-98ed-5b20abaee26e tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.571s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:19.887939 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:19.890749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:19.910113 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:19.913338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:19.913338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:19.913338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:19.913338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:19.913338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:20.343943 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 03:34:20.345839 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:20.345839 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:20.345839 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:20.346251 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:20.394290 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:20.395074 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729660.394803, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:20.396014 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Paused (Lifecycle Event)
May 14 03:34:20.419385 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Took 12.70 seconds to spawn the instance on the hypervisor.
May 14 03:34:20.419385 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:20.518510 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:20.518716 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.518891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.520294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:20.520499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:20.521065 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received unexpected event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with vm_state active and task_state None.
May 14 03:34:20.521065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:20.521156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.521523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.522079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:20.524458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] No waiting events found dispatching network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:20.524458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:20.524458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:20.524458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Acquiring lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.524458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.525093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] Lock "f444aa34-be20-4e14-acd9-19c487ab903f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:20.525093 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] No waiting events found dispatching network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:20.525093 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859eb5ed-65b8-4e91-8d4b-12104cc84127 req-354fd06b-5626-47f7-a51c-eafe36fa9c44 service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-unplugged-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:20.539508 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:20.811776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.811938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.823148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.823322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.823783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:20.823947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:20.824161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:20.827178 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Terminating instance
May 14 03:34:20.901939 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:20.907243 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729660.9069934, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:20.908555 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Resumed (Lifecycle Event)
May 14 03:34:20.939354 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Took 20.16 seconds to build instance.
May 14 03:34:21.161188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44b2357e-dcdd-4fc7-af39-1b24b454e9cc tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.690s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:21.218966 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c1c4c7d-168e-4591-a0ef-8af65fbe764e req-aec3e175-853f-4407-b36c-88bd36fdcffb service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Received event network-vif-deleted-e571c1f8-0f1f-4c5d-9b08-4fe2020002cb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:21.219590 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-8c1c4c7d-168e-4591-a0ef-8af65fbe764e req-aec3e175-853f-4407-b36c-88bd36fdcffb service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Neutron deleted interface e571c1f8-0f1f-4c5d-9b08-4fe2020002cb; detaching it from the instance and deleting it from the info cache
May 14 03:34:21.220148 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8c1c4c7d-168e-4591-a0ef-8af65fbe764e req-aec3e175-853f-4407-b36c-88bd36fdcffb service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:21.318985 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:21.333214 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:21.361383 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:21.366537 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:21.390923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:21.393045 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:21.412762 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:21.415050 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:21.420807 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:21.442733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.668s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:21.525123 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.527083 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.527083 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.527884 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.527884 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.528144 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.528302 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.528576 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.528878 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:34:21.529074 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:34:21.638283 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:21.674923 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Instance destroyed successfully.
May 14 03:34:21.675366 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lazy-loading 'resources' on Instance uuid ed521445-93a9-42d1-bd32-da5d03ecfe95 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:21.726693 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c1c4c7d-168e-4591-a0ef-8af65fbe764e req-aec3e175-853f-4407-b36c-88bd36fdcffb service nova] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Detach interface failed, port_id=e571c1f8-0f1f-4c5d-9b08-4fe2020002cb, reason: Instance f444aa34-be20-4e14-acd9-19c487ab903f could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:34:21.919223 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99971116100005 future=<Future at 0x79d0b8292330 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:22.036361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:22.036545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:22.036680 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:22.036804 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:34:22.141538 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Took 1.80 seconds to deallocate network for instance.
May 14 03:34:22.178802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-443284770',display_name='tempest-AttachSCSIVolumeTestJSON-server-443284770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachscsivolumetestjson-server-443284770',id=4,image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxNXrpuc3mlukgcNwB7toJEahEfe3v6AaW8QvG4Kgd+8vOFbNOgAa5xPNZyClsSwy4Om8Zs8Wu3l41w04FR56OqKjzHx3iLsP8zppgH/9SnwRIrIt0U6S9T/JYJjOcLkg==',key_name='tempest-keypair-1760705408',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:21Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20d8ae1101e445b1b2e501e52a2d3f90',ramdisk_id='',reservation_id='r-vlfntqpo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ba372dd9-ab35-46f8-bcbf-0d67ffb0bc66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1194742276',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1194742276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd2c73a16b8240fe82731ffe8581c72e',uuid=ed521445-93a9-42d1-bd32-da5d03ecfe95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:22.179089 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converting VIF {"id": "bf614564-cbed-475f-a34c-341baa20235d", "address": "fa:16:3e:86:fd:94", "network": {"id": "946fbbc1-ecee-4a21-9fa6-f32e87b5e199", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1443360327-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20d8ae1101e445b1b2e501e52a2d3f90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf614564-cb", "ovs_interfaceid": "bf614564-cbed-475f-a34c-341baa20235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:22.179732 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:22.180001 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:22.181820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:22.182110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf614564-cb, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:22.184204 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:22.185377 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:22.186517 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:22.186708 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f1b5cd2-67f1-47a2-94a6-17dde02cfbe1) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:22.187372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:22.188083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:22.194678 np0000000741 nova-compute[97948]: INFO os_vif [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:fd:94,bridge_name='br-int',has_traffic_filtering=True,id=bf614564-cbed-475f-a34c-341baa20235d,network=Network(946fbbc1-ecee-4a21-9fa6-f32e87b5e199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf614564-cb')
May 14 03:34:22.194678 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Deleting instance files /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95_del
May 14 03:34:22.194678 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Deletion of /opt/stack/data/nova/instances/ed521445-93a9-42d1-bd32-da5d03ecfe95_del complete
May 14 03:34:22.324140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:22.648761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:22.648761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:22.701447 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:34:22.701921 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:22.702619 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:22.702757 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:22.702932 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:22.790218 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:23.069847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.138977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:23.139309 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:23.181876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:23.181876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.258619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:23.280428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:23.285390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:34:23.286044 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'ed521445-93a9-42d1-bd32-da5d03ecfe95' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ed521445-93a9-42d1-bd32-da5d03ecfe95' (instance-00000004)
May 14 03:34:23.290514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:34:23.290970 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:34:23.291250 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:34:23.294006 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.335165 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:23.336922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:23.337241 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:23.337371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:23.337862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] No waiting events found dispatching network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:23.337862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:23.340218 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:23.340218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Acquiring lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:23.340218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] No waiting events found dispatching network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-unplugged-bf614564-cbed-475f-a34c-341baa20235d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-changed-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Refreshing instance network info cache due to event network-changed-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Acquiring lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Acquired lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:23.345041 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Refreshing network info cache for port 85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:23.405680 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:23.406184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.467551 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:23.467891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:23.468227 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Attaching volume 8623c897-9970-4f9a-90b7-d87adee3fe00 to /dev/vdb
May 14 03:34:23.510928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:23.514706 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:34:23.516929 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:34:23.518361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.545905 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:23.555484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.036s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:23.560420 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13602MB free_disk=74.65011978149414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:34:23.561481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:23.564167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:34:23.587317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:23.623334 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da44fa5-d504-4457-b4e2-144d5cf94608 req-80229fb7-de0c-4a5c-9794-163742bfa376 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Received event network-vif-deleted-bf614564-cbed-475f-a34c-341baa20235d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:23.624725 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-6da44fa5-d504-4457-b4e2-144d5cf94608 req-80229fb7-de0c-4a5c-9794-163742bfa376 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Neutron deleted interface bf614564-cbed-475f-a34c-341baa20235d; detaching it from the instance and deleting it from the info cache
May 14 03:34:23.624725 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6da44fa5-d504-4457-b4e2-144d5cf94608 req-80229fb7-de0c-4a5c-9794-163742bfa376 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:23.626165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:34:23.627998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:34:23.638484 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:34:23.639828 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe45:afc5', 'fe80::b9:89ff:fe09:14bb', 'fe80::fc16:3eff:feaa:a6a', 'fe80::fc16:3eff:fe5d:1104', 'fe80::20af:60ff:fe2b:e842', 'fe80::fc16:3eff:fe5f:92e', 'fe80::fc16:3eff:fe9b:29ce', 'fe80::fc16:3eff:fed3:280d', 'fe80::fc16:3eff:fea4:891e', 'fe80::fc16:3eff:fe96:e2b5', 'fe80::64f7:dff:fe73:777d', 'fe80::fc16:3eff:fe3b:aa63', 'fe80::acd3:9bff:fea1:18bc', 'fe80::fc16:3eff:feb5:d892', 'fe80::ec7e:ff:fe82:25e9'] 
May 14 03:34:23.640020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:34:23.640157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:34:23.640486 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:23.640785 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating existing volume attachment record: 548dca98-cf8b-4cf9-9eb7-7d77ddcc49d2 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:34:23.645277 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:23.842470 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:23.847742 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:24.061176 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:24.132364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da44fa5-d504-4457-b4e2-144d5cf94608 req-80229fb7-de0c-4a5c-9794-163742bfa376 service nova] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Detach interface failed, port_id=bf614564-cbed-475f-a34c-341baa20235d, reason: Instance ed521445-93a9-42d1-bd32-da5d03ecfe95 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:34:24.155809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.505s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:24.157422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.596s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:24.218463 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:34:24.218823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:24.219012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:24.219456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:24.219655 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:34:24.235814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:24.236260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:24.236884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:24.237983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:24.238230 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:34:24.238567 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:24.252374 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:24.252374 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:34:24.263723 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:34:24.263723 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:24.269365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:24.277075 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Deleted allocations for instance f444aa34-be20-4e14-acd9-19c487ab903f
May 14 03:34:24.283751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.294455 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.295219 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:24.295219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:24.296255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] HCTL ('13', '0', '0', 0) found on session 21 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:24.296255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.305017 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching for a device in session 21 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:24.305856 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:24.305856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:24.306743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:24.306743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:34:24.307026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] HCTL ('14', '0', '0', 0) found on session 22 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:34:24.307369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:34:24.317816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Searching for a device in session 22 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:34:24.317816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:34:24.411862 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:24.563205 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Took 1.86 seconds to deallocate network for instance.
May 14 03:34:24.708547 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updated VIF entry in instance network info cache for port 85ebf74d-7491-40f6-8d0b-502c1e3b6e7d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:34:24.709808 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating instance_info_cache with network_info: [{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:24.934092 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:25.072592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:25.212497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3dd1554a-82ba-4d04-a10f-20e97e18f716 req-54f448a3-7fcf-4394-858e-04cc2373a6e5 service nova] Releasing lock "refresh_cache-7ff50ead-8117-44fd-9be6-8ac88fa1f76d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:25.236900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:34:25.240905 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ed521445-93a9-42d1-bd32-da5d03ecfe95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:34:25.241394 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c2f3a900-f95f-44ca-832c-117a1239d831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:34:25.241394 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c3ced606-f7f2-4b81-974d-4c064e3801d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:34:25.241394 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 32cb8438-d425-4069-84c9-35886e83c12d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:34:25.241394 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7ff50ead-8117-44fd-9be6-8ac88fa1f76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:34:25.241725 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:34:25.241784 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:34:23 up 26 min,  2 users,  load average: 7.71, 3.83, 1.79\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_deleting': '1', 'num_os_type_None': '5', 'num_proj_20d8ae1101e445b1b2e501e52a2d3f90': '1', 'io_workload': '0', 'num_task_None': '4', 'num_proj_e10298a13b54449ba0a0421dd9982254': '2', 'num_proj_3a911ae5ca594e7eb624869133cb0973': '1', 'num_proj_2c875214b84942f4b242e6a4213ba7ff': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:34:25.290949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6b08ac3f-5795-420a-8878-4a34d91e19a9 tempest-VolumesAssistedSnapshotsTest-157421557 tempest-VolumesAssistedSnapshotsTest-157421557-project-member] Lock "f444aa34-be20-4e14-acd9-19c487ab903f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.868s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:25.568120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:25.569758 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:25.864195 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:26.072218 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:26.257877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found WWN 3300000004e197c3e for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:34:26.258149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:26.258358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] <== connect_volume: return (2039ms) {'type': 'block', 'scsi_wwn': '3300000004e197c3e', 'path': '/dev/dm-5', 'multipath_id': '3300000004e197c3e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:26.258521 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004e197c3e', 'path': '/dev/dm-5', 'multipath_id': '3300000004e197c3e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:34:26.266402 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:26.581285 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:34:26.581285 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.424s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:26.581742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.509s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:26.582125 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.20 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:34:26.772874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Attempting to attach volume 8623c897-9970-4f9a-90b7-d87adee3fe00 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:34:26.774145 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:26.774145 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:34:27.007181 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:27.007385 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:27.188391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:27.510126 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:27.867081 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:28.018050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.436s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:28.085193 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Deleted allocations for instance ed521445-93a9-42d1-bd32-da5d03ecfe95
May 14 03:34:28.262679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:28.472192 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:28.474600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:28.474600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:28.474600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] No VIF found with MAC fa:16:3e:aa:0a:6a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:28.590171 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:29.097120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-787189a5-be75-48f6-846d-9b1ebce36713 tempest-AttachSCSIVolumeTestJSON-1194742276 tempest-AttachSCSIVolumeTestJSON-1194742276-project-member] Lock "ed521445-93a9-42d1-bd32-da5d03ecfe95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.274s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:29.301623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:29.301623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:29.803427 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:34:30.064624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1dd9470-f4ff-434d-a1af-3cbd87ecf964 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.596s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:30.155665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:30.385741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:30.387009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:30.393069 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:34:30.394723 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Claim successful on node np0000000741
May 14 03:34:30.532369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:31.219910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:31.220098 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:31.688726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:31.689219 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:31.722409 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Detaching volume 8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:31.775792 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Attempting to driver detach volume 8623c897-9970-4f9a-90b7-d87adee3fe00 from mountpoint /dev/vdb
May 14 03:34:31.778816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found disk vdb by alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:31.780007 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found disk vdb by alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:31.780163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Attempting to detach device vdb from instance c3ced606-f7f2-4b81-974d-4c064e3801d1 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:34:31.780472 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:31.780472 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:31.785311 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully detached device vdb from instance c3ced606-f7f2-4b81-974d-4c064e3801d1 from the persistent domain config.
May 14 03:34:31.785489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] (1/8): Attempting to detach device vdb with device alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 from instance c3ced606-f7f2-4b81-974d-4c064e3801d1 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:34:31.785759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:31.785759 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:32.191279 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:32.192217 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:32.445995 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729672.4454346, c3ced606-f7f2-4b81-974d-4c064e3801d1 => ua-8623c897-9970-4f9a-90b7-d87adee3fe00> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:34:32.449019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 for instance c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:34:32.453876 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully detached device vdb from instance c3ced606-f7f2-4b81-974d-4c064e3801d1 from the live domain config.
May 14 03:34:32.700300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.314s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:32.700801 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:34:33.007235 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Detected multiple connections on this host for volume: 8623c897-9970-4f9a-90b7-d87adee3fe00, skipping target disconnect.
May 14 03:34:33.024074 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:33.208662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:34:33.208662 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:34:33.208662 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:33.208662 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:33.269031 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:33.329747 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c969f8c1275340d3b8a0bbcb62a497ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e394a2d53341d59d512810b2a3dea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:34:33.590598 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:33.712300 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:34:33.883180 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:33.883481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:33.906581 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Successfully created port: 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:34:33.913708 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:34.215819 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:34:34.286815 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0009519669999917824 future=<Future at 0x79d0b0742b70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:34.286815 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:34.286815 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.632342372000039 future=<Future at 0x79d0b8292330 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:34.286815 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.6322539499999493 future=<Future at 0x79d0b8292330 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:34.287226 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Emitting event <LifecycleEvent: 1778729659.2851868, f444aa34-be20-4e14-acd9-19c487ab903f => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:34.287467 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] VM Stopped (Lifecycle Event)
May 14 03:34:34.385610 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:34:34.598939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c1bbaebc-ddf6-4dfc-81ba-dbde4f90f6cd tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.379s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:34.618501 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Successfully updated port: 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:34:34.684426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-changed-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:34.684510 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Refreshing instance network info cache due to event network-changed-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:34.684703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] Acquiring lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:34.685006 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] Acquired lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:34.685006 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Refreshing network info cache for port 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:34.793543 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: f444aa34-be20-4e14-acd9-19c487ab903f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:34.958688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:34.959150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:34.962357 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:34:34.962490 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Claim successful on node np0000000741
May 14 03:34:35.121420 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:35.186947 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:35.229804 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:34:35.230930 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:34:35.231548 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Creating image(s)
May 14 03:34:35.231784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:35.232019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:35.232580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:35.233335 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:35.241319 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:35.241319 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:35.278658 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:35.347834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:35.347834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:35.347990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:35.349055 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:35.353595 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:35.353595 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:35.454446 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:35.455858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:35.511406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk 1073741824" returned: 0 in 0.055s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:35.513152 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:35.513476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:35.549745 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:35.604333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:35.604796 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:34:35.605626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:35.695941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:35.696384 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Cannot resize image /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:34:35.696748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:34:35.696914 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Ensure instance console log exists: /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:34:35.697232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:35.697415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:35.697627 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:35.789685 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:35.789941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:36.060328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0ace4335-d365-489c-97cb-80710377a0bc req-aa4fc397-0558-4d67-b61b-064e5cba8a51 service nova] Releasing lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:36.060328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquired lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:36.060328 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:34:36.152132 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:36.293537 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Detaching volume 8623c897-9970-4f9a-90b7-d87adee3fe00
May 14 03:34:36.352199 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Attempting to driver detach volume 8623c897-9970-4f9a-90b7-d87adee3fe00 from mountpoint /dev/vdb
May 14 03:34:36.360308 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found disk vdb by alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:36.362267 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Found disk vdb by alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:34:36.362375 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Attempting to detach device vdb from instance c2f3a900-f95f-44ca-832c-117a1239d831 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:34:36.362672 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:36.362672 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:36.368843 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully detached device vdb from instance c2f3a900-f95f-44ca-832c-117a1239d831 from the persistent domain config.
May 14 03:34:36.368984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] (1/8): Attempting to detach device vdb with device alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 from instance c2f3a900-f95f-44ca-832c-117a1239d831 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:34:36.369295 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <alias name="ua-8623c897-9970-4f9a-90b7-d87adee3fe00"/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <serial>8623c897-9970-4f9a-90b7-d87adee3fe00</serial>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]: </disk>
May 14 03:34:36.369295 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:34:36.375269 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:36.375776 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:36.664120 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:36.854105 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:36.884307 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:36.919517 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005618000000140455 future=<Future at 0x79d0b8292330 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:36.919949 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:36.920536 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b318245e-284d-4675-b865-ea07c416e586 None None] Emitting event <LifecycleEvent: 1778729661.9188178, ed521445-93a9-42d1-bd32-da5d03ecfe95 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:36.920791 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b318245e-284d-4675-b865-ea07c416e586 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] VM Stopped (Lifecycle Event)
May 14 03:34:37.039672 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating instance_info_cache with network_info: [{"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:37.193128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:37.391541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.432s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:37.392105 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:34:37.427751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b318245e-284d-4675-b865-ea07c416e586 None None] [instance: ed521445-93a9-42d1-bd32-da5d03ecfe95] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:37.543819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Releasing lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:37.543819 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance network_info: |[{"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:34:37.544653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Start _get_guest_xml network_info=[{"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:34:37.548148 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:37.549679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:37.549679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:37.549791 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:37.549971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] No waiting events found dispatching network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:37.550714 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:34:37.551838 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e3da4e8e-d938-436d-b676-7e62ae0e2e6e req-ab2ef90d-68ab-4d59-8411-92e72e2daada service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received unexpected event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 for instance with vm_state building and task_state spawning.
May 14 03:34:37.553089 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1823611732', uuid='0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6'), owner=OwnerMeta(userid='c969f8c1275340d3b8a0bbcb62a497ed', username='tempest-VolumesBackupsTest-645442672-project-member', projectid='20e394a2d53341d59d512810b2a3dea2', projectname='tempest-VolumesBackupsTest-645442672'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729677.5515344) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:34:37.553415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:34:37.553625 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:34:37.556817 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:34:37.557221 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:34:37.557221 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:34:37.557221 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:34:37.557286 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:34:37.571216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1823611732',display_name='tempest-VolumesBackupsTest-instance-1823611732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1823611732',id=10,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJA/lcMeaBxcnML1vyVJL+uN0tv2j4RgVyW0Pz7fN5T0oDdSSlif2e2iDNSgRA1nF2e2vY4EACGYdxdtKwRN963zVyb9U0BwgoLAE7RR4mKYnUro2r4YuBKtiQHhb60g==',key_name='tempest-keypair-1513035425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-gdn4xl5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:34:37.571512 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:37.572117 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:37.572849 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:37.902152 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:34:37.902152 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:34:37.902152 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:37.902152 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:38.007658 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5965648eb844445ba39309f715cae8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540edf423c7349798850fccbd7415216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:34:38.075949 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] End _get_guest_xml xml=<domain type="qemu">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <uuid>0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6</uuid>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <name>instance-0000000a</name>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesBackupsTest-instance-1823611732</nova:name>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:34:37</nova:creationTime>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:user uuid="c969f8c1275340d3b8a0bbcb62a497ed">tempest-VolumesBackupsTest-645442672-project-member</nova:user>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:project uuid="20e394a2d53341d59d512810b2a3dea2">tempest-VolumesBackupsTest-645442672</nova:project>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         <nova:port uuid="5a2e8e58-3168-4ec8-99e9-93b0b64aaf56">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <system>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="serial">0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="uuid">0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </system>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <os>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </os>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <features>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </features>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   <devices>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.config"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:61:62:07"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <target dev="tap5a2e8e58-31"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </interface>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/console.log" append="off"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </serial>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <video>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </video>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </rng>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:   </devices>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]: </domain>
May 14 03:34:38.075949 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Preparing to wait for external event network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1823611732',display_name='tempest-VolumesBackupsTest-instance-1823611732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1823611732',id=10,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJA/lcMeaBxcnML1vyVJL+uN0tv2j4RgVyW0Pz7fN5T0oDdSSlif2e2iDNSgRA1nF2e2vY4EACGYdxdtKwRN963zVyb9U0BwgoLAE7RR4mKYnUro2r4YuBKtiQHhb60g==',key_name='tempest-keypair-1513035425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-gdn4xl5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e908e73-e35f-5b1a-9be1-cff5d6d6f9a3', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.083745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:38.087016 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.090937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.091098 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a2e8e58-31, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:38.091491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a2e8e58-31, col_values=(('qos', UUID('c0eda8b2-4bd4-4a83-9812-09aeeed6dcbb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:38.092605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a2e8e58-31, col_values=(('external_ids', {'iface-id': '5a2e8e58-3168-4ec8-99e9-93b0b64aaf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:62:07', 'vm-uuid': '0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:38.092605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.095598 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:38.099585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.100541 np0000000741 nova-compute[97948]: INFO os_vif [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31')
May 14 03:34:38.273433 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:38.401158 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:34:38.490395 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:34:38.518192 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Successfully created port: 89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:34:38.556321 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729678.5557823, c2f3a900-f95f-44ca-832c-117a1239d831 => ua-8623c897-9970-4f9a-90b7-d87adee3fe00> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:34:38.558612 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8623c897-9970-4f9a-90b7-d87adee3fe00 for instance c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:34:38.560611 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully detached device vdb from instance c2f3a900-f95f-44ca-832c-117a1239d831 from the live domain config.
May 14 03:34:38.609541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:38.609989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:38.610152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:38.610601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:38.611035 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8623c897-9970-4f9a-90b7-d87adee3fe00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:38.611213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:38.654430 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '9')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '21')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:38.654430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00', '22')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:38.655714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81c2480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'): ({'sdi'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:38.655714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:38.655714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Flush multipath device 3300000004e197c3e {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:38.690184 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:38.738191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:38.779485 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:38.779649 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:38.782157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:38.793756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:38.793992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:38.806197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.844496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.40.100,3260]
May 14 03:34:38.844496 np0000000741 nova-compute[97948]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.40.100,3260] successful.
May 14 03:34:38.844496 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.869195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.886688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.908047 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:34:38.932880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.50.100,3260]
May 14 03:34:38.932880 np0000000741 nova-compute[97948]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8623c897-9970-4f9a-90b7-d87adee3fe00, portal: 192.168.50.100,3260] successful.
May 14 03:34:38.932880 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.951836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:38.951836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:38.951836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] <== disconnect_volume: return (341ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:38.951836 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:39.160041 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Successfully updated port: 89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:34:39.221065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Received event network-changed-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:39.221065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Refreshing instance network info cache due to event network-changed-89bc44ad-c710-45d0-ac20-2337903e9251. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:39.221065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] Acquiring lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:39.221065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] Acquired lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:39.221065 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Refreshing network info cache for port 89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:39.519210 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'flavor' on Instance uuid c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:39.620418 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:39.620685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:39.620685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No VIF found with MAC fa:16:3e:61:62:07, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:39.621043 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Using config drive
May 14 03:34:39.662353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:39.725671 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:39.807013 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:39.916434 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:34:39.917344 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:34:39.917555 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Creating image(s)
May 14 03:34:39.920364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:39.920364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:39.920364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:39.920364 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:39.925942 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:39.927231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.020690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.021249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:40.021891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:40.022477 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:40.030577 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:34:40.032454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.060006 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:40.130168 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:40.131998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.132977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.182545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk 1073741824" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.183090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:40.183427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.288306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.290041 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:34:40.290911 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.385507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.386798 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Cannot resize image /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:34:40.387347 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:34:40.387503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:34:40.387943 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:40.388197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:40.388391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:40.453866 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Creating config drive at /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.config
May 14 03:34:40.459526 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeqah5fx4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:40.508842 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeqah5fx4" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:40.533588 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-848ea7a2-47e4-4396-b4d2-f22d97fe1bab tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.744s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:40.564580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3afa2e4c-a3b6-4362-8bc4-17828e15cb5c req-7e8e199e-a382-4a71-b741-84db5cc5b293 service nova] Releasing lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:40.566244 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquired lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:40.566441 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:34:40.755220 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.012366 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.051581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.151935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.236197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:41.236403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:41.236607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:41.236934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:41.236934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:41.241168 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Terminating instance
May 14 03:34:41.275862 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:34:41.354822 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:41.354822 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:41.355353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:41.355353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:41.355353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:41.357667 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Terminating instance
May 14 03:34:41.374146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.379531 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.385005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.415140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.493628 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:41.673395 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Updating instance_info_cache with network_info: [{"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:41.746496 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:41.773861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.778873 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.802323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.865060 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:41.897468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.900944 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.931549 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.936705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.948080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:41.964010 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:41.964226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:41.965082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:41.965385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:41.966421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] No waiting events found dispatching network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:41.966975 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1d6bfb4-fb96-4adb-b832-d333712f19ab req-74e05141-446f-4b3a-a6e6-dd69ecf60381 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:41.973867 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.017498 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.078079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.093603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.148285 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729682.1478543, 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:42.148616 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] VM Started (Lifecycle Event)
May 14 03:34:42.176289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Releasing lock "refresh_cache-1ec9f026-1e02-46ed-868e-0dc032c99ba2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:42.176289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance network_info: |[{"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:34:42.179860 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Start _get_guest_xml network_info=[{"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:34:42.186619 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:34:42.187798 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1455493412', uuid='1ec9f026-1e02-46ed-868e-0dc032c99ba2'), owner=OwnerMeta(userid='5965648eb844445ba39309f715cae8fa', username='tempest-VolumesActionsTest-329536730-project-member', projectid='540edf423c7349798850fccbd7415216', projectname='tempest-VolumesActionsTest-329536730'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729682.187429) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:34:42.195054 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:34:42.195440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:34:42.203242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:34:42.203242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:34:42.205025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:34:42.205314 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:34:42.205475 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:34:42.205590 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:34:42.205673 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:34:42.205785 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:34:42.205882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:34:42.206043 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:34:42.206139 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:34:42.206238 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:34:42.206329 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:34:42.206497 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:34:42.218855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1455493412',display_name='tempest-VolumesActionsTest-instance-1455493412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-1455493412',id=11,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-ukkvdfpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:39Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=1ec9f026-1e02-46ed-868e-0dc032c99ba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:34:42.221682 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:42.221682 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:42.224664 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Instance destroyed successfully.
May 14 03:34:42.225499 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec9f026-1e02-46ed-868e-0dc032c99ba2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:42.227328 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'resources' on Instance uuid c2f3a900-f95f-44ca-832c-117a1239d831 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:42.231246 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Instance destroyed successfully.
May 14 03:34:42.234444 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lazy-loading 'resources' on Instance uuid c3ced606-f7f2-4b81-974d-4c064e3801d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:42.654180 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:42.658349 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729682.6555927, 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:42.658349 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] VM Paused (Lifecycle Event)
May 14 03:34:42.730429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] End _get_guest_xml xml=<domain type="qemu">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <uuid>1ec9f026-1e02-46ed-868e-0dc032c99ba2</uuid>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <name>instance-0000000b</name>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesActionsTest-instance-1455493412</nova:name>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:34:42</nova:creationTime>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:user uuid="5965648eb844445ba39309f715cae8fa">tempest-VolumesActionsTest-329536730-project-member</nova:user>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:project uuid="540edf423c7349798850fccbd7415216">tempest-VolumesActionsTest-329536730</nova:project>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         <nova:port uuid="89bc44ad-c710-45d0-ac20-2337903e9251">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <system>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="serial">1ec9f026-1e02-46ed-868e-0dc032c99ba2</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="uuid">1ec9f026-1e02-46ed-868e-0dc032c99ba2</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </system>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <os>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </os>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <features>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </features>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   <devices>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.config"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </disk>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:52:1a:56"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <target dev="tap89bc44ad-c7"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </interface>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/console.log" append="off"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </serial>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <video>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </video>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </rng>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:   </devices>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]: </domain>
May 14 03:34:42.730429 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:34:42.732784 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Preparing to wait for external event network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:34:42.732784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:42.732784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:42.732784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:42.732784 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1455493412',display_name='tempest-VolumesActionsTest-instance-1455493412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-1455493412',id=11,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-ukkvdfpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:34:39Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=1ec9f026-1e02-46ed-868e-0dc032c99ba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:34:42.732996 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:42.733875 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:42.734193 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:34:42.735305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-1',id=6,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:33:26Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c2f3a900-f95f-44ca-832c-117a1239d831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:42.736488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1771135874-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testmultiattachvolumeswap-server-1771135874-2',id=7,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEch2Xc39bD8Zbt2ODcDMF/dPmfGap2Cp+b0Pv29RiekticWgbM4m9xX7/YOaFZWFpHvscuM7vCFOGXjGtDKx6OLFgzSROigJanENT0iE5Rqj8s6TB4LkORjzeepAB4f8g==',key_name='tempest-keypair-270964787',keypairs=<?>,launch_index=1,launched_at=2026-05-14T03:33:29Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10298a13b54449ba0a0421dd9982254',ramdisk_id='',reservation_id='r-mrrvd3k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1464080636',owner_user_name='tempest-TestMultiAttachVolumeSwap-1464080636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='268a04e0eb684905bd884ec47edd208d',uuid=c3ced606-f7f2-4b81-974d-4c064e3801d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:42.736746 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "address": "fa:16:3e:aa:0a:6a", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cff4c1-89", "ovs_interfaceid": "d5cff4c1-8912-41dc-97c5-aa9ad87391c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:42.737312 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converting VIF {"id": "c089441d-bae2-4d49-a901-db7d9bc95f20", "address": "fa:16:3e:45:af:c5", "network": {"id": "a2fcd494-0a4d-4eb4-956f-3367fe311cd8", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2121008943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10298a13b54449ba0a0421dd9982254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc089441d-ba", "ovs_interfaceid": "c089441d-bae2-4d49-a901-db7d9bc95f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:42.737795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.738367 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:42.738841 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:42.739348 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.739803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:34:42.740744 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:42.741072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.741235 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:42.741777 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29515dfd-762d-59f3-a885-5eb9dd0706a4', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.744227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.770676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.772285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.773140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc089441d-ba, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.775983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.775983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.781484 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.783536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.783536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5cff4c1-89, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.785149 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.786562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.788120 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.788120 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89bc44ad-c7, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.788120 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89bc44ad-c7, col_values=(('qos', UUID('1ab14be4-8d2c-4391-9cc5-41fdac0e90fb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.788120 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89bc44ad-c7, col_values=(('external_ids', {'iface-id': '89bc44ad-c710-45d0-ac20-2337903e9251', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:1a:56', 'vm-uuid': '1ec9f026-1e02-46ed-868e-0dc032c99ba2'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.789096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.791022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.796196 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.797343 np0000000741 nova-compute[97948]: INFO os_vif [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7')
May 14 03:34:42.797892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.798193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c25cd29-598f-4224-8303-85774d29bc37) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.798853 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.799392 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.809115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.809493 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.809724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=858814c3-73c9-4408-961f-b899f93e293a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:42.810507 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.811286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:42.813876 np0000000741 nova-compute[97948]: INFO os_vif [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=c089441d-bae2-4d49-a901-db7d9bc95f20,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc089441d-ba')
May 14 03:34:42.814154 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Deleting instance files /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831_del
May 14 03:34:42.814899 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Deletion of /opt/stack/data/nova/instances/c2f3a900-f95f-44ca-832c-117a1239d831_del complete
May 14 03:34:42.817857 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:42.823307 np0000000741 nova-compute[97948]: INFO os_vif [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0a:6a,bridge_name='br-int',has_traffic_filtering=True,id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5,network=Network(a2fcd494-0a4d-4eb4-956f-3367fe311cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cff4c1-89')
May 14 03:34:42.823307 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Deleting instance files /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1_del
May 14 03:34:42.823307 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Deletion of /opt/stack/data/nova/instances/c3ced606-f7f2-4b81-974d-4c064e3801d1_del complete
May 14 03:34:43.162084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:43.164564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:43.275344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:43.323472 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Took 1.58 seconds to destroy the instance on the hypervisor.
May 14 03:34:43.325429 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:43.325971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:43.326059 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:43.326330 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:43.331364 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Took 1.47 seconds to destroy the instance on the hypervisor.
May 14 03:34:43.332156 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:43.332623 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:43.333081 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:43.333401 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:43.669827 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:43.670765 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999771933000147 future=<Future at 0x79d0b0758aa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:43.670765 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999550728000031 future=<Future at 0x79d0b0758aa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:43.670765 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999421520000169 future=<Future at 0x79d0b0758aa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:43.670897 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999778643999889 future=<Future at 0x79d0b84aeae0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:44.327825 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:44.328432 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:34:44.328432 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No VIF found with MAC fa:16:3e:52:1a:56, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:34:44.331544 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Using config drive
May 14 03:34:44.706461 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:44.707453 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:44.758454 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:44.793773 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:44.835403 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:45.240864 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:45.241012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] Acquiring lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:45.241948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:45.241948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] Lock "c2f3a900-f95f-44ca-832c-117a1239d831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:45.242185 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] No waiting events found dispatching network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:45.242185 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa22669-d865-47df-bb9c-b791e632a91f req-845e1669-c140-47a0-a896-53a825f42257 service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-unplugged-c089441d-bae2-4d49-a901-db7d9bc95f20 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:45.257379 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Creating config drive at /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.config
May 14 03:34:45.269676 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79708790-7197-4d4a-a26d-3e216e70849b req-9046fa26-21fe-4c32-9744-2e77d550963c service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:45.269898 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79708790-7197-4d4a-a26d-3e216e70849b req-9046fa26-21fe-4c32-9744-2e77d550963c service nova] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:45.270066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79708790-7197-4d4a-a26d-3e216e70849b req-9046fa26-21fe-4c32-9744-2e77d550963c service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:45.270201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79708790-7197-4d4a-a26d-3e216e70849b req-9046fa26-21fe-4c32-9744-2e77d550963c service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:45.270370 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79708790-7197-4d4a-a26d-3e216e70849b req-9046fa26-21fe-4c32-9744-2e77d550963c service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Processing event network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:34:45.271656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:34:45.275457 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729685.2751102, 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:45.275576 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] VM Resumed (Lifecycle Event)
May 14 03:34:45.278486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:34:45.280684 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c5a4be0-a74e-4a9e-9b6c-b99abfa2f97b req-51f66fdf-e6f7-4287-b519-c24465e7644c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-vif-deleted-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:45.280988 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-3c5a4be0-a74e-4a9e-9b6c-b99abfa2f97b req-51f66fdf-e6f7-4287-b519-c24465e7644c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Neutron deleted interface d5cff4c1-8912-41dc-97c5-aa9ad87391c5; detaching it from the instance and deleting it from the info cache
May 14 03:34:45.281071 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3c5a4be0-a74e-4a9e-9b6c-b99abfa2f97b req-51f66fdf-e6f7-4287-b519-c24465e7644c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:45.285079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi2iodb0j {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:34:45.317915 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance spawned successfully.
May 14 03:34:45.320031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:34:45.343750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi2iodb0j" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:34:45.603762 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:45.812407 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:45.819770 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c5a4be0-a74e-4a9e-9b6c-b99abfa2f97b req-51f66fdf-e6f7-4287-b519-c24465e7644c service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Detach interface failed, port_id=d5cff4c1-8912-41dc-97c5-aa9ad87391c5, reason: Instance c3ced606-f7f2-4b81-974d-4c064e3801d1 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:34:45.820862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:45.835769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.835878 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.836530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.836856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.837292 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.837748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:45.913291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:45.954765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:45.956916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:46.067735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:46.105341 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Took 2.77 seconds to deallocate network for instance.
May 14 03:34:46.213789 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:46.305530 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:46.317734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:46.328852 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:46.344460 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Took 11.11 seconds to spawn the instance on the hypervisor.
May 14 03:34:46.345077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:46.346475 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:46.615304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:46.615520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:46.716203 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Took 3.39 seconds to deallocate network for instance.
May 14 03:34:46.855980 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Took 16.54 seconds to build instance.
May 14 03:34:47.055194 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:47.055437 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:47.109466 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729687.1091163, 1ec9f026-1e02-46ed-868e-0dc032c99ba2 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:47.109688 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] VM Started (Lifecycle Event)
May 14 03:34:47.224131 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.342105 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a0c1d232-ec5b-4305-81cd-ffe0a2b01e83 req-0f3f8811-5d58-46db-bfa6-3d44961cf11d service nova] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Received event network-vif-deleted-c089441d-bae2-4d49-a901-db7d9bc95f20 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.358058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fd2a51df-e50f-4d66-8145-03ca469b1a69 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.057s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.370769 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.372612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.372612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:47.372612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.373047 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] No waiting events found dispatching network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:47.373047 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received unexpected event network-vif-plugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 for instance with vm_state active and task_state None.
May 14 03:34:47.373047 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.373268 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.373394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:47.373820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.373910 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] No waiting events found dispatching network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:47.374069 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received unexpected event network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 for instance with vm_state deleted and task_state None.
May 14 03:34:47.374220 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received event network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.374376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Acquiring lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.374505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:47.374675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.374812 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] No waiting events found dispatching network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:47.374955 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Received unexpected event network-vif-unplugged-d5cff4c1-8912-41dc-97c5-aa9ad87391c5 for instance with vm_state deleted and task_state None.
May 14 03:34:47.375096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Received event network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.375231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.375346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:47.375448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.375602 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Processing event network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:34:47.375736 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Received event network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:47.375837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:47.375939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:47.376045 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:47.376118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] No waiting events found dispatching network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:47.376292 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2188c8b7-307e-49ef-a809-be429bce18b9 req-aea3e5ef-42fd-4874-8811-8386db1b8441 service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Received unexpected event network-vif-plugged-89bc44ad-c710-45d0-ac20-2337903e9251 for instance with vm_state building and task_state spawning.
May 14 03:34:47.376653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:34:47.379716 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:34:47.381614 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance spawned successfully.
May 14 03:34:47.381979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:34:47.559933 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:47.612412 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:47.614468 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:47.811232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:47.893759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:47.893759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:47.893759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:47.893759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:47.893759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:47.895392 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:34:48.071667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.453s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:48.071667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.847s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:48.117064 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:34:48.118315 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729688.117913, 1ec9f026-1e02-46ed-868e-0dc032c99ba2 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:48.118696 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] VM Paused (Lifecycle Event)
May 14 03:34:48.177815 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Deleted allocations for instance c3ced606-f7f2-4b81-974d-4c064e3801d1
May 14 03:34:48.276852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:48.401109 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Took 8.48 seconds to spawn the instance on the hypervisor.
May 14 03:34:48.401780 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:48.485962 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:48.486377 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:48.602547 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:48.623325 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:48.625355 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729688.625061, 1ec9f026-1e02-46ed-868e-0dc032c99ba2 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:48.625436 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] VM Resumed (Lifecycle Event)
May 14 03:34:48.912855 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Took 14.02 seconds to build instance.
May 14 03:34:48.990583 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:49.088579 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:49.129170 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:49.133805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:34:49.191948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-779efc2c-8a4a-4596-9cee-218375736f95 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c3ced606-f7f2-4b81-974d-4c064e3801d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.837s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:49.415529 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.532s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:49.500132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.429s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:49.593556 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Deleted allocations for instance c2f3a900-f95f-44ca-832c-117a1239d831
May 14 03:34:50.020963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:50.605551 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-73f0b38c-2543-4972-b91c-1df0e98d7a31 tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Lock "c2f3a900-f95f-44ca-832c-117a1239d831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.369s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:51.211889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:52.498078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:52.500079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:52.500195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:52.500340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:52.500506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:52.503942 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Terminating instance
May 14 03:34:52.643980 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-changed-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:52.644180 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Refreshing instance network info cache due to event network-changed-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:34:52.644497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] Acquiring lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:34:52.644596 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] Acquired lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:34:52.645112 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Refreshing network info cache for port 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:34:52.812077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.009747 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:53.046092 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.071824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.076142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.105427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.108885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.151734 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:53.277652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.346118 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999699538999948 future=<Future at 0x79d0b81b4380 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:53.348135 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Instance destroyed successfully.
May 14 03:34:53.349531 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lazy-loading 'resources' on Instance uuid 1ec9f026-1e02-46ed-868e-0dc032c99ba2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:53.379941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:53.380120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:53.380383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:53.380546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:53.380546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:53.382705 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Terminating instance
May 14 03:34:53.854489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1455493412',display_name='tempest-VolumesActionsTest-instance-1455493412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-1455493412',id=11,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:48Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-ukkvdfpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:48Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=1ec9f026-1e02-46ed-868e-0dc032c99ba2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:53.855164 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "89bc44ad-c710-45d0-ac20-2337903e9251", "address": "fa:16:3e:52:1a:56", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bc44ad-c7", "ovs_interfaceid": "89bc44ad-c710-45d0-ac20-2337903e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:53.855486 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:53.855799 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:53.858939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.859286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89bc44ad-c7, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:53.862931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:53.866797 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.867001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ab14be4-8d2c-4391-9cc5-41fdac0e90fb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:53.869146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:53.873396 np0000000741 nova-compute[97948]: INFO os_vif [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1a:56,bridge_name='br-int',has_traffic_filtering=True,id=89bc44ad-c710-45d0-ac20-2337903e9251,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bc44ad-c7')
May 14 03:34:53.873504 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Deleting instance files /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2_del
May 14 03:34:53.875130 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Deletion of /opt/stack/data/nova/instances/1ec9f026-1e02-46ed-868e-0dc032c99ba2_del complete
May 14 03:34:53.886805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:34:53.952565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.960890 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:53.985667 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.017927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.018875 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.068886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.089389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.095153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.157740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.193679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.219929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.229453 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.257688 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.263737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.323556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.328669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.343885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.362514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.388167 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 03:34:54.388712 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:54.391659 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:54.391659 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:54.391659 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:54.399805 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:54.590547 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999730405000037 future=<Future at 0x79d0b0463710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:54.599189 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Instance destroyed successfully.
May 14 03:34:54.599983 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lazy-loading 'resources' on Instance uuid 32cb8438-d425-4069-84c9-35886e83c12d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:34:55.058168 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:55.103445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.103617 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.104249 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.104544 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.109653 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.110270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744344e1-b2, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.122445 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.124990 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.160367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.162146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.162146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe7b2daf-54d3-45be-9a54-ae9ea5995207) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.162984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.163795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.202181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.203759 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:11:04,bridge_name='br-int',has_traffic_filtering=True,id=744344e1-b2f8-4495-89b2-9e5b882480bc,network=Network(f2db1485-c5c4-4828-8011-632139198ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744344e1-b2')
May 14 03:34:55.204453 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.204629 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.205446 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.205843 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.207241 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.207511 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa48b3dfc-3d, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.208744 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.210133 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.237664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.239365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.239365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82e13574-5bf1-4db9-b5fc-c2b99f9dba47) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.240074 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.241252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.273085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.275147 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:09:2e,bridge_name='br-int',has_traffic_filtering=True,id=a48b3dfc-3d84-4ab7-b620-cebe09037d71,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa48b3dfc-3d')
May 14 03:34:55.276100 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.276541 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.277330 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.278337 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.280328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.280551 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf74f34b2-c0, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.282795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.284142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.305792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.307849 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.308048 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5616bbd-a851-4260-b20a-45af5c712b5d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.308562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.309759 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.338475 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.340439 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:29:ce,bridge_name='br-int',has_traffic_filtering=True,id=f74f34b2-c049-43f3-b870-a0c6f42ab0d2,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf74f34b2-c0')
May 14 03:34:55.341127 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.341401 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.341995 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.342407 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.353084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.353084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa061b1c3-6c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.354466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.355232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.377213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.384972 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.385281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbd28853-b6c0-40cd-a9c0-d53f43de5a63) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.386193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.388531 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.399065 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.401527 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:28:0d,bridge_name='br-int',has_traffic_filtering=True,id=a061b1c3-6cc7-4056-a432-29d76d3cfef0,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa061b1c3-6c')
May 14 03:34:55.402590 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.402889 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.403612 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.405279 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.406170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.406533 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7adb9002-2f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.408634 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.409693 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.425284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.426181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.427062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a57e6e7-1a53-444f-802b-ffe66492e62b) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.429735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.432113 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.441925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.445948 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:89:1e,bridge_name='br-int',has_traffic_filtering=True,id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a,network=Network(60eccb78-7864-401d-a696-53d7f5bd50dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adb9002-2f')
May 14 03:34:55.446619 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.446815 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.447380 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.447703 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.450824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.451830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaba7e22f-33, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.452813 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.454379 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.460624 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.461860 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.463131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b2aebd8-5b8d-4b8f-a306-0e69c275ba96) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.465690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.469262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61701419-f03a-4bde-8c7c-933f736e0ca3 req-e4e9cec8-c1d1-4aef-b07b-4539e7d6ebfc service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Received event network-vif-deleted-89bc44ad-c710-45d0-ac20-2337903e9251 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:55.469262 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-61701419-f03a-4bde-8c7c-933f736e0ca3 req-e4e9cec8-c1d1-4aef-b07b-4539e7d6ebfc service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Neutron deleted interface 89bc44ad-c710-45d0-ac20-2337903e9251; detaching it from the instance and deleting it from the info cache
May 14 03:34:55.469262 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-61701419-f03a-4bde-8c7c-933f736e0ca3 req-e4e9cec8-c1d1-4aef-b07b-4539e7d6ebfc service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:55.472323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.477437 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:55.483859 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:b5,bridge_name='br-int',has_traffic_filtering=True,id=aba7e22f-3355-445f-a830-c60dba6d8ae1,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba7e22f-33')
May 14 03:34:55.483859 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-677097887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-677097887',id=8,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY3+eYPkqoji1Q6dHZM2SKwPHQYbD6eF+2JIcPY0udZNBEh0zQVKRe283jTL+8gZE3c42PU/JY0EkdkyBIpE7pD7MeMfQJMcxiFG/NQjTlRjgG3l8qozOM6UVl2pQsQQ==',key_name='tempest-keypair-1900283239',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a911ae5ca594e7eb624869133cb0973',ramdisk_id='',reservation_id='r-ueueeko2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-787669211',owner_user_name='tempest-TaggedBootDevicesTest-787669211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='018a70105e254d36b7ce8a3fe6bd973c',uuid=32cb8438-d425-4069-84c9-35886e83c12d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:34:55.483859 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converting VIF {"id": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "address": "fa:16:3e:3b:aa:63", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f6fa62-71", "ovs_interfaceid": "b9f6fa62-7146-452e-a16c-ff2c8d82625c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:34:55.483859 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:34:55.483859 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:34:55.486230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.488096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9f6fa62-71, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.492201 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.495256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.497607 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.497851 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ae00e1f-dea5-4fe1-b69a-2ae40bc6a175) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:34:55.498547 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:55.499772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:34:55.502311 np0000000741 nova-compute[97948]: INFO os_vif [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:aa:63,bridge_name='br-int',has_traffic_filtering=True,id=b9f6fa62-7146-452e-a16c-ff2c8d82625c,network=Network(b47dc341-2e84-42f8-899d-eb6cd3a96bb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f6fa62-71')
May 14 03:34:55.503620 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:55.504174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:55.504336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:55.505070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:55.506468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d12ec63-80b5-44bc-a32e-991a977db826', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:55.506993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826 (non-flash)
May 14 03:34:55.542046 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '9')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:55.542046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '9')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:55.544965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826', '10')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:55.544965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b815d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:55.544965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:55.544965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Flush multipath device 3300000007724b52d {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:55.600968 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:55.642432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:55.686790 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updated VIF entry in instance network info cache for port 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:34:55.687278 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating instance_info_cache with network_info: [{"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:55.689260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:55.689595 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:55.691410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:55.706437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:55.707584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:55.720387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.759058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.40.100,3260]
May 14 03:34:55.759058 np0000000741 nova-compute[97948]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.40.100,3260] successful.
May 14 03:34:55.759058 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.780932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.793442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.831315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.50.100,3260]
May 14 03:34:55.831315 np0000000741 nova-compute[97948]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-6d12ec63-80b5-44bc-a32e-991a977db826, portal: 192.168.50.100,3260] successful.
May 14 03:34:55.831315 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.850540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:55.851033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:55.851370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== disconnect_volume: return (346ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:55.851370 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:55.852575 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:55.853063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:55.853195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:55.853539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:55.853921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:55.854116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:55.869336 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.884137 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:55.884417 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:55.884554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:55.884933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '11')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:55.886318 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f', '12')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:55.886890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b079ba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:55.887131 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:55.887336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Flush multipath device 3300000006615fb08 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:55.920326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:55.976953 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61701419-f03a-4bde-8c7c-933f736e0ca3 req-e4e9cec8-c1d1-4aef-b07b-4539e7d6ebfc service nova] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Detach interface failed, port_id=89bc44ad-c710-45d0-ac20-2337903e9251, reason: Instance 1ec9f026-1e02-46ed-868e-0dc032c99ba2 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:34:55.977874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:56.022876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:56.023085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:56.024429 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:56.037159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:56.037469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:56.051452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.083971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.40.100,3260]
May 14 03:34:56.083971 np0000000741 nova-compute[97948]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.40.100,3260] successful.
May 14 03:34:56.083971 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.105418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.123166 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.161985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.50.100,3260]
May 14 03:34:56.161985 np0000000741 nova-compute[97948]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-3c7b9a65-c0f9-4f04-85bf-0e8d61a31a1f, portal: 192.168.50.100,3260] successful.
May 14 03:34:56.161985 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.177704 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.177993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:56.178166 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== disconnect_volume: return (325ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:56.178556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:56.182782 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:34:56.183123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:34:56.183306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:34:56.183827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:34:56.184162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86362a6a-4ab1-452e-b99b-16c52823980c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:34:56.184336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:34:56.190498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a400c545-f5ad-4d7e-a9a5-8a2b8e1eac25 req-5e297e76-0308-42bf-8df5-f9a5418fe779 service nova] Releasing lock "refresh_cache-0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:34:56.217963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:56.217963 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:56.217963 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:56.217963 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:56.217963 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:34:56.218133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:56.218133 np0000000741 nova-compute[97948]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c (non-flash)
May 14 03:34:56.218133 np0000000741 nova-compute[97948]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:56.218133 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:34:56.218133 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:34:56.218288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:34:56.218452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '14')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:56.219646 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c', '13')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:34:56.220653 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8709d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:34:56.224537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:34:56.224902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Flush multipath device 3300000003c095387 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:34:56.268580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:56.316021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:56.325149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:34:56.372597 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Took 1.98 seconds to deallocate network for instance.
May 14 03:34:56.378961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:34:56.378961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:34:56.380155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:34:56.395627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:34:56.395837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:34:56.411782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.445510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.40.100,3260]
May 14 03:34:56.445510 np0000000741 nova-compute[97948]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.40.100,3260] successful.
May 14 03:34:56.445510 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.478902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.499319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.528935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.50.100,3260]
May 14 03:34:56.528935 np0000000741 nova-compute[97948]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-86362a6a-4ab1-452e-b99b-16c52823980c, portal: 192.168.50.100,3260] successful.
May 14 03:34:56.528935 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.547390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:34:56.547750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:34:56.547935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] <== disconnect_volume: return (364ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:34:56.548121 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:34:56.548464 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Deleting instance files /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d_del
May 14 03:34:56.549138 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Deletion of /opt/stack/data/nova/instances/32cb8438-d425-4069-84c9-35886e83c12d_del complete
May 14 03:34:56.881144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:56.881144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:57.059503 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Took 3.17 seconds to destroy the instance on the hypervisor.
May 14 03:34:57.060844 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:34:57.060844 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:34:57.060844 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:34:57.061087 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:57.165617 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:34:57.165617 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:34:57.261216 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:57.407524 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:34:57.671166 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:34:58.179430 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.298s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:58.238006 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Deleted allocations for instance 1ec9f026-1e02-46ed-868e-0dc032c99ba2
May 14 03:34:58.279665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:58.671119 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0010933419998764293 future=<Future at 0x79d0b0758aa0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.671717 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.671717 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0009415960000751511 future=<Future at 0x79d0b84aeae0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.671937 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0011798730001828517 future=<Future at 0x79d0b84aeae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.673076 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Emitting event <LifecycleEvent: 1778729683.6699295, c2f3a900-f95f-44ca-832c-117a1239d831 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:58.673538 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.673632 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.671783214000016 future=<Future at 0x79d0b81b4380 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.674047 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] VM Stopped (Lifecycle Event)
May 14 03:34:58.674047 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.671390274000032 future=<Future at 0x79d0b81b4380 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:34:58.676405 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Emitting event <LifecycleEvent: 1778729683.6706202, c3ced606-f7f2-4b81-974d-4c064e3801d1 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:34:58.676405 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] VM Stopped (Lifecycle Event)
May 14 03:34:59.177881 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c8437072-4f5c-48e0-9192-746539521730 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: c2f3a900-f95f-44ca-832c-117a1239d831] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:59.180409 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: c3ced606-f7f2-4b81-974d-4c064e3801d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:34:59.244005 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:34:59.244269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:34:59.244409 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:34:59.244531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:59.244647 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:34:59.244758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dde1de04-968e-4f25-ba63-a2ad816c0d2f req-fd3d804a-0589-4d16-8f22-227b51e94099 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:34:59.248238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8bfe502-fdc9-4764-bd3b-95f004533952 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "1ec9f026-1e02-46ed-868e-0dc032c99ba2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.748s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:34:59.330751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:34:59.858871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:00.499203 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:00.888507 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79f168cc-0dae-4795-8bb6-f73535a36b64 req-42c1da26-879a-49d1-9f14-2f392d0ef16d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-deleted-b9f6fa62-7146-452e-a16c-ff2c8d82625c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:00.888752 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-79f168cc-0dae-4795-8bb6-f73535a36b64 req-42c1da26-879a-49d1-9f14-2f392d0ef16d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Neutron deleted interface b9f6fa62-7146-452e-a16c-ff2c8d82625c; detaching it from the instance and deleting it from the info cache
May 14 03:35:00.889334 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-79f168cc-0dae-4795-8bb6-f73535a36b64 req-42c1da26-879a-49d1-9f14-2f392d0ef16d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "address": "fa:16:3e:d3:28:0d", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa061b1c3-6c", "ovs_interfaceid": "a061b1c3-6cc7-4056-a432-29d76d3cfef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:00.931792 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Rebuilding instance
May 14 03:35:01.083384 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:01.355059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:01.355879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:01.355935 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:01.356099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:01.356164 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:01.356347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-a061b1c3-6cc7-4056-a432-29d76d3cfef0 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:01.356460 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:01.356506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:01.356628 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:01.357128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:01.357318 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:01.357502 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:01.357990 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:01.358239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:01.358520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:01.358571 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:01.358814 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:01.358932 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2a06f638-2dc9-4c80-9ff0-e27dd15319be req-659090a0-dd76-47f7-bdde-b5585d59d342 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:01.394183 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79f168cc-0dae-4795-8bb6-f73535a36b64 req-42c1da26-879a-49d1-9f14-2f392d0ef16d service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Detach interface failed, port_id=b9f6fa62-7146-452e-a16c-ff2c8d82625c, reason: Instance 32cb8438-d425-4069-84c9-35886e83c12d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:35:01.551380 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b7e9926-bd5e-45ee-8103-b458c9a5a536 req-c9efa557-63c3-41cc-8d33-138c753bcfc2 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-deleted-a061b1c3-6cc7-4056-a432-29d76d3cfef0 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:01.554419 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-1b7e9926-bd5e-45ee-8103-b458c9a5a536 req-c9efa557-63c3-41cc-8d33-138c753bcfc2 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Neutron deleted interface a061b1c3-6cc7-4056-a432-29d76d3cfef0; detaching it from the instance and deleting it from the info cache
May 14 03:35:01.554419 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1b7e9926-bd5e-45ee-8103-b458c9a5a536 req-c9efa557-63c3-41cc-8d33-138c753bcfc2 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "address": "fa:16:3e:96:e2:b5", "network": {"id": "b47dc341-2e84-42f8-899d-eb6cd3a96bb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1339142111", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba7e22f-33", "ovs_interfaceid": "aba7e22f-3355-445f-a830-c60dba6d8ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:02.058862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b7e9926-bd5e-45ee-8103-b458c9a5a536 req-c9efa557-63c3-41cc-8d33-138c753bcfc2 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Detach interface failed, port_id=a061b1c3-6cc7-4056-a432-29d76d3cfef0, reason: Instance 32cb8438-d425-4069-84c9-35886e83c12d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:35:02.114933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.118808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.137216 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.146901 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.165544 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.170080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.425784 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.435099 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.449188 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99967801999992 future=<Future at 0x79d0b84ae570 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:02.451566 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance destroyed successfully.
May 14 03:35:02.458550 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance destroyed successfully.
May 14 03:35:02.460387 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1500104163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:20Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:35:02.460844 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:02.461819 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:02.462351 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:35:02.465764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.466052 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ebf74d-74, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:02.470980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:02.472022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.472189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=879d442e-0eb6-4c18-be71-99430994413a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:02.476354 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:02.478335 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:02.484324 np0000000741 nova-compute[97948]: INFO os_vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74')
May 14 03:35:02.484572 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:35:02.484870 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:02.486127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:02.486127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:02.486127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:35:02.486127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:35:02.511195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:02.511195 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:02.511195 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:02.511390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:02.511390 np0000000741 nova-compute[97948]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:02.511390 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:02.511500 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:35:02.511663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '20')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:35:02.512381 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '19')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:35:02.513202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81eda80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'): ({'sdl'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:35:02.515859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Removing multipathed devices sdm, sdl {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:35:02.515859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flush multipath device 3300000004fd344d4 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:35:02.544632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:02.544971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:02.612130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:35:02.663539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:35:02.715239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:35:02.715416 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:35:02.715981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:35:02.727942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:35:02.728175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:35:02.739340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.765719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260]
May 14 03:35:02.765719 np0000000741 nova-compute[97948]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260] successful.
May 14 03:35:02.765719 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.780966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.794266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.821480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260]
May 14 03:35:02.821480 np0000000741 nova-compute[97948]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260] successful.
May 14 03:35:02.821480 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.833766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:02.833956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:02.834073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== disconnect_volume: return (349ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:02.834213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:35:02.834454 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deleting instance files /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d_del
May 14 03:35:02.835128 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deletion of /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d_del complete
May 14 03:35:03.032460 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-deleted-aba7e22f-3355-445f-a830-c60dba6d8ae1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:03.032630 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Neutron deleted interface aba7e22f-3355-445f-a830-c60dba6d8ae1; detaching it from the instance and deleting it from the info cache
May 14 03:35:03.033589 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "address": "fa:16:3e:a4:89:1e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adb9002-2f", "ovs_interfaceid": "7adb9002-2fb8-4c9e-85ad-7ffa01ce949a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:03.036576 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:03.047486 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:03.281177 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:03.469390 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7ff50ead-8117-44fd-9be6-8ac88fa1f76d could not be found.
May 14 03:35:03.470591 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:35:03.471001 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:03.471647 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:03.472110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:03.472529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:35:03.472705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:35:03.488126 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
May 14 03:35:03.488126 np0000000741 nova-compute[97948]: : NotImplementedError
May 14 03:35:03.504574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:03.504574 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:03.504835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:03.504835 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:03.504835 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:35:03.504835 np0000000741 nova-compute[97948]: : NotImplementedError
May 14 03:35:03.504986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Sessions list: [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:35:03.504986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:35:03.505698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:35:03.505866 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:35:03.506026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:35:03.506217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81ec7c0>, {}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:35:03.506368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Disconnecting from: [] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:35:03.506632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:03.506851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== disconnect_volume: return (36ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:03.506955 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:35:03.539942 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Detach interface failed, port_id=aba7e22f-3355-445f-a830-c60dba6d8ae1, reason: Instance 32cb8438-d425-4069-84c9-35886e83c12d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:35:03.540120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:03.540519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:03.540908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:03.541318 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:03.541701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:03.541853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:03.541958 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-deleted-7adb9002-2fb8-4c9e-85ad-7ffa01ce949a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:03.542130 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Neutron deleted interface 7adb9002-2fb8-4c9e-85ad-7ffa01ce949a; detaching it from the instance and deleting it from the info cache
May 14 03:35:03.542330 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "744344e1-b2f8-4495-89b2-9e5b882480bc", "address": "fa:16:3e:5d:11:04", "network": {"id": "f2db1485-c5c4-4828-8011-632139198ddf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1989245338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap744344e1-b2", "ovs_interfaceid": "744344e1-b2f8-4495-89b2-9e5b882480bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:03.622147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:03.622581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:03.628101 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:03.628265 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Claim successful on node np0000000741
May 14 03:35:03.731968 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-036ee0fa-3b3e-4446-bea6-babdd5055667 req-ebb40a15-b32f-4237-b93f-5c7c0ead5076 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-deleted-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:03.732152 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-036ee0fa-3b3e-4446-bea6-babdd5055667 req-ebb40a15-b32f-4237-b93f-5c7c0ead5076 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Neutron deleted interface 744344e1-b2f8-4495-89b2-9e5b882480bc; detaching it from the instance and deleting it from the info cache
May 14 03:35:03.732407 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-036ee0fa-3b3e-4446-bea6-babdd5055667 req-ebb40a15-b32f-4237-b93f-5c7c0ead5076 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [{"id": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "address": "fa:16:3e:5f:09:2e", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa48b3dfc-3d", "ovs_interfaceid": "a48b3dfc-3d84-4ab7-b620-cebe09037d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "address": "fa:16:3e:9b:29:ce", "network": {"id": "60eccb78-7864-401d-a696-53d7f5bd50dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1406219740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a911ae5ca594e7eb624869133cb0973", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f34b2-c0", "ovs_interfaceid": "f74f34b2-c049-43f3-b870-a0c6f42ab0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:04.047799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9e7c6d2-8760-4629-b8e5-037400a4e680 req-22788b87-688e-4861-8f7c-dfcb39928412 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Detach interface failed, port_id=7adb9002-2fb8-4c9e-85ad-7ffa01ce949a, reason: Instance 32cb8438-d425-4069-84c9-35886e83c12d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:35:04.131463 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:04.237209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-036ee0fa-3b3e-4446-bea6-babdd5055667 req-ebb40a15-b32f-4237-b93f-5c7c0ead5076 service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Detach interface failed, port_id=744344e1-b2f8-4495-89b2-9e5b882480bc, reason: Instance 32cb8438-d425-4069-84c9-35886e83c12d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:35:04.637207 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Took 7.58 seconds to deallocate network for instance.
May 14 03:35:04.694537 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Preparing to wait for external event volume-reimaged-f4f4fe53-19a1-4009-b32b-4dc114f19b52 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:04.694703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:04.694921 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:04.695256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:05.023802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:05.024057 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:05.210010 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:05.210353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] Acquiring lock "32cb8438-d425-4069-84c9-35886e83c12d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:05.210353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:05.210535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] Lock "32cb8438-d425-4069-84c9-35886e83c12d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:05.211007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] No waiting events found dispatching network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:05.211007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7606f55e-07e9-461f-b6f0-519c6a3757ba req-7a0d6b19-555c-4e3f-8b0d-0ae481b68f9f service nova] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Received event network-vif-unplugged-744344e1-b2f8-4495-89b2-9e5b882480bc for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:05.526864 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:05.621081 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:05.621306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:06.034815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.412s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:06.035353 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:06.066794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:06.126677 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:06.364869 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Took 1.72 seconds to detach 3 volumes for instance.
May 14 03:35:06.543533 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:06.543533 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:06.543668 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:06.545098 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:06.652031 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5965648eb844445ba39309f715cae8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540edf423c7349798850fccbd7415216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:06.707019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:06.707468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:06.712373 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:06.712373 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Claim successful on node np0000000741
May 14 03:35:06.873213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:07.046107 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:07.149488 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Successfully created port: b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:07.473798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:07.533624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:07.533868 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:07.550200 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:08.036100 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:08.152911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:08.153402 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:08.172160 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Successfully updated port: b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:08.257235 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-changed-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:08.257632 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Refreshing instance network info cache due to event network-changed-b518c1d1-b5cf-41e3-a674-174d2211c99d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:08.257882 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] Acquiring lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:08.258028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] Acquired lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:08.258201 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Refreshing network info cache for port b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:08.291053 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:08.346205 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000771065999970233 future=<Future at 0x79d0b81b4380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:08.346327 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:08.346531 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.243786608999926 future=<Future at 0x79d0b0463710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:08.348092 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.2436664679999012 future=<Future at 0x79d0b0463710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:08.348092 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b318245e-284d-4675-b865-ea07c416e586 None None] Emitting event <LifecycleEvent: 1778729693.3452778, 1ec9f026-1e02-46ed-868e-0dc032c99ba2 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:08.348092 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b318245e-284d-4675-b865-ea07c416e586 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] VM Stopped (Lifecycle Event)
May 14 03:35:08.559569 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:08.560728 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:08.560994 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Creating image(s)
May 14 03:35:08.563666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:08.563666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:08.563666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:08.563666 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:08.575488 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:08.577256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:08.610012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:08.656728 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:08.662308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:08.662772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:08.663196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:08.663840 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:08.668498 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:08.669522 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:08.692954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:08.753552 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:08.753909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:08.767530 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:08.798730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk 1073741824" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:08.799147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:08.799548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:08.851147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b318245e-284d-4675-b865-ea07c416e586 None None] [instance: 1ec9f026-1e02-46ed-868e-0dc032c99ba2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:08.860542 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:08.876472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:08.877039 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:35:08.877299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:08.960064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:08.960495 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:35:08.961075 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:35:08.961309 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Ensure instance console log exists: /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:08.961633 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:08.961914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:08.962086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:09.026657 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:09.170480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.463s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:09.171117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:09.175585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.302s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:09.531117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48d5cf08-cd54-426b-88fe-1bf890273a76 req-3e8a717f-f20e-40ac-b79a-187bc36e58f5 service nova] Releasing lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:09.532438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquired lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:09.532505 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:09.550264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:09.550459 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:09.591132 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0008652779999920313 future=<Future at 0x79d0b0463710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:09.592004 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] Emitting event <LifecycleEvent: 1778729694.5901878, 32cb8438-d425-4069-84c9-35886e83c12d => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:09.592170 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] VM Stopped (Lifecycle Event)
May 14 03:35:09.593347 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:09.595452 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.853577272999928 future=<Future at 0x79d0b84ae570 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:09.596405 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.852422584999886 future=<Future at 0x79d0b84ae570 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:09.679051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:09.679264 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:09.679577 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:09.679859 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:09.756950 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82973e4b28774576bcce6851483a08f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf8c09511e44fecb39453337950bdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:10.053911 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:10.096883 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cdfe478b-5bc4-45a6-9279-91873de7efce tempest-TestMultiAttachVolumeSwap-1464080636 tempest-TestMultiAttachVolumeSwap-1464080636-project-member] [instance: 32cb8438-d425-4069-84c9-35886e83c12d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:10.101680 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:10.185533 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:10.244385 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Successfully created port: 436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:10.283002 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:10.425945 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Updating instance_info_cache with network_info: [{"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:10.561376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.386s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:10.563287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.952s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:10.567019 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:10.567160 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Claim successful on node np0000000741
May 14 03:35:10.627371 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Deleted allocations for instance 32cb8438-d425-4069-84c9-35886e83c12d
May 14 03:35:10.688824 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:10.740768 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Successfully updated port: 436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:10.747706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:10.747834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:10.794993 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-changed-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:10.795151 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing instance network info cache due to event network-changed-436c7406-82ac-4fb5-bcd8-5039846e810a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:10.795253 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:10.795346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:10.795472 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing network info cache for port 436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:10.928196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Releasing lock "refresh_cache-b1ab08ef-80e1-42ea-8257-1a8d5bf62105" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:10.928413 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance network_info: |[{"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:35:10.929852 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Start _get_guest_xml network_info=[{"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:10.932446 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:10.933939 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-138158398', uuid='b1ab08ef-80e1-42ea-8257-1a8d5bf62105'), owner=OwnerMeta(userid='5965648eb844445ba39309f715cae8fa', username='tempest-VolumesActionsTest-329536730-project-member', projectid='540edf423c7349798850fccbd7415216', projectname='tempest-VolumesActionsTest-329536730'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729710.9334857) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:10.934790 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:10.935206 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:10.936205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:10.936352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:10.937445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:10.937760 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:10.937882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:10.937991 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:10.938103 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:10.938160 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:10.938255 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:10.938400 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:10.938487 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:10.938654 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:10.938823 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:10.938965 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:10.951930 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138158398',display_name='tempest-VolumesActionsTest-instance-138158398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-138158398',id=12,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-4xki1y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:08Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=b1ab08ef-80e1-42ea-8257-1a8d5bf62105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:10.952118 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:10.952564 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:10.953064 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ab08ef-80e1-42ea-8257-1a8d5bf62105 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:11.243498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:11.250142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:11.297753 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:11.374628 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:11.392021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.455992 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <uuid>b1ab08ef-80e1-42ea-8257-1a8d5bf62105</uuid>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <name>instance-0000000c</name>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesActionsTest-instance-138158398</nova:name>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:10</nova:creationTime>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:user uuid="5965648eb844445ba39309f715cae8fa">tempest-VolumesActionsTest-329536730-project-member</nova:user>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:project uuid="540edf423c7349798850fccbd7415216">tempest-VolumesActionsTest-329536730</nova:project>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         <nova:port uuid="b518c1d1-b5cf-41e3-a674-174d2211c99d">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="serial">b1ab08ef-80e1-42ea-8257-1a8d5bf62105</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="uuid">b1ab08ef-80e1-42ea-8257-1a8d5bf62105</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.config"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:56:41:86"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <target dev="tapb518c1d1-b5"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/console.log" append="off"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:11.455992 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Preparing to wait for external event network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138158398',display_name='tempest-VolumesActionsTest-instance-138158398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-138158398',id=12,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-4xki1y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:08Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=b1ab08ef-80e1-42ea-8257-1a8d5bf62105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:11.458428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.458789 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:11.458947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:11.459467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.459621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32ee137a-792d-5c15-8a19-ff807355e7ae', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:11.460973 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.461118 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:11.461711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.464209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.464209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb518c1d1-b5, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:11.464398 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb518c1d1-b5, col_values=(('qos', UUID('60ee30cc-269d-4235-8e8f-199f1ddfc8e6')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:11.464613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb518c1d1-b5, col_values=(('external_ids', {'iface-id': 'b518c1d1-b5cf-41e3-a674-174d2211c99d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:41:86', 'vm-uuid': 'b1ab08ef-80e1-42ea-8257-1a8d5bf62105'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:11.465582 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.466712 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:11.474692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:11.477421 np0000000741 nova-compute[97948]: INFO os_vif [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5')
May 14 03:35:11.554147 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:11.636344 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f91723ca-675c-475c-baf4-18d063d53e4e tempest-TaggedBootDevicesTest-787669211 tempest-TaggedBootDevicesTest-787669211-project-member] Lock "32cb8438-d425-4069-84c9-35886e83c12d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.256s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:11.696712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:11.697865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:11.698274 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Creating image(s)
May 14 03:35:11.698674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:11.699062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:11.700814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:11.701894 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:11.704422 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:11.710576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:11.798677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:11.799138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:11.799828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:11.802903 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:11.807754 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:11.808454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:11.832716 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:11.890074 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.081s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:11.890550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:11.947748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk 1073741824" returned: 0 in 0.057s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:11.948202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:11.948527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:12.012962 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:12.013286 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:12.041562 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:12.042099 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:35:12.042425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:12.060599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e9fda3c3-d36d-4eb9-8bbf-dbc8de026461 req-db1d1b4e-416c-49c6-bbf7-678edec99c90 service nova] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:12.061963 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:12.062373 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:12.127835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:12.128321 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Cannot resize image /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:35:12.128837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:35:12.129053 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Ensure instance console log exists: /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:12.129391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:12.129690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:12.129907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:12.516397 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:12.641013 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:12.785203 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:12.785203 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 03:35:12.806877 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:12.829689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a3db4917-27ff-4de5-8688-1a874a92b3d5 req-50ba654e-fd18-4b04-98f4-9af8840e7dab service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event volume-reimaged-f4f4fe53-19a1-4009-b32b-4dc114f19b52 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:12.830336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a3db4917-27ff-4de5-8688-1a874a92b3d5 req-50ba654e-fd18-4b04-98f4-9af8840e7dab service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:12.830608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a3db4917-27ff-4de5-8688-1a874a92b3d5 req-50ba654e-fd18-4b04-98f4-9af8840e7dab service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:12.830914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a3db4917-27ff-4de5-8688-1a874a92b3d5 req-50ba654e-fd18-4b04-98f4-9af8840e7dab service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:12.830984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a3db4917-27ff-4de5-8688-1a874a92b3d5 req-50ba654e-fd18-4b04-98f4-9af8840e7dab service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Processing event volume-reimaged-f4f4fe53-19a1-4009-b32b-4dc114f19b52 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:12.831713 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance event wait completed in 7 seconds for volume-reimaged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:12.954710 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:13.000023 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:13.000219 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:13.000362 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] No VIF found with MAC fa:16:3e:56:41:86, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:13.001332 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Using config drive
May 14 03:35:13.024033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.462s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:13.024092 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:13.027386 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.196s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:13.031677 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:13.032063 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Claim successful on node np0000000741
May 14 03:35:13.286958 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] There are 0 instances to clean {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 03:35:13.287230 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:13.287379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97948) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 03:35:13.292096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:13.338163 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Booting with volume f4f4fe53-19a1-4009-b32b-4dc114f19b52 at /dev/vda
May 14 03:35:13.370392 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:13.370904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:13.372073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:13.372073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:13.372073 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:13.372073 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-684e9c74-effc-4145-88e9-0a3254ca40c2 req-dc790238-8514-4d5d-88fc-66370c263550 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received unexpected event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with vm_state active and task_state rebuild_block_device_mapping.
May 14 03:35:13.386949 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:13.398536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:35:13.421176 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:13.457371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:13.458006 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance network_info: |[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:35:13.460560 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Start _get_guest_xml network_info=[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:13.462454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:35:13.462905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:35:13.464015 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:13.465520 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-105715718', uuid='8dbcc9c2-0ce8-4450-9772-a532b41e53f7'), owner=OwnerMeta(userid='82973e4b28774576bcce6851483a08f9', username='tempest-TaggedAttachmentsTest-1383375675-project-member', projectid='0bf8c09511e44fecb39453337950bdf2', projectname='tempest-TaggedAttachmentsTest-1383375675'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729713.4651282) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:13.466655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:13.467054 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:13.468302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:13.469656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:13.469656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:13.469950 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:13.470068 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:13.470158 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:13.470307 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:13.470440 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:13.470568 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:13.470754 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:13.470868 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:13.470966 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:13.471068 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:13.471210 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:13.481624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:35:13.482615 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772'] 
May 14 03:35:13.482825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:35:13.482962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:35:13.483205 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:13.483393 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating existing volume attachment record: 228d3b89-5014-466c-9200-a867c6894bd1 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:35:13.490438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:13.490438 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:13.491110 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:13.491665 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:13.507081 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:13.530828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:13.531236 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:13.531460 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:13.531694 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:13.602040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:13.668569 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53104358366841619575ce8b9b680e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817445e1e7da4d278a96c6cdd6c14c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:13.718987 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Creating config drive at /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.config
May 14 03:35:13.722210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp38icz4wd {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:13.770217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp38icz4wd" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:13.792220 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:13.995285 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <uuid>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</uuid>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <name>instance-0000000d</name>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:13</nova:creationTime>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="serial">8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="uuid">8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:8e:f1:03"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <target dev="tap436c7406-82"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log" append="off"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:13.995285 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:13.997563 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Preparing to wait for external event network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:13.997563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:13.997563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:13.997563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:13.997563 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:13.997830 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:13.998404 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:13.998754 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:13.999099 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:13.999479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:13.999884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:14.000528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.000730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26fcf3fc-8f4f-558a-86a6-62559a9554d6', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:14.003215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.004406 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:14.010147 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.019684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.019684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap436c7406-82, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:14.019684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap436c7406-82, col_values=(('qos', UUID('797abdee-bcc4-45fa-a6af-ebca4ec9e20e')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:14.019684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap436c7406-82, col_values=(('external_ids', {'iface-id': '436c7406-82ac-4fb5-bcd8-5039846e810a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:f1:03', 'vm-uuid': '8dbcc9c2-0ce8-4450-9772-a532b41e53f7'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:14.022119 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.025084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:14.035210 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:14.039365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.043536 np0000000741 nova-compute[97948]: INFO os_vif [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82')
May 14 03:35:14.234807 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Successfully created port: 620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:14.279598 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.295246 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:35:14.312661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.314242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.423116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.462259 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:14.462700 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:14.541269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:14.653326 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.661841 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.665346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.696675 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.702394 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:14.969083 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:14.976626 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Successfully updated port: 620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:15.055672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-changed-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:15.055858 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Refreshing instance network info cache due to event network-changed-620119d0-d806-4e90-b497-d5103f24a42d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:15.056496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] Acquiring lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:15.056629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] Acquired lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:15.056824 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Refreshing network info cache for port 620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:15.357319 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729715.3568225, b1ab08ef-80e1-42ea-8257-1a8d5bf62105 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:15.357971 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] VM Started (Lifecycle Event)
May 14 03:35:15.481336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.454s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.483321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:15.485978 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:15.493699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:15.494538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.494806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.495025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.495220 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:15.495456 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received unexpected event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with vm_state active and task_state rebuild_spawning.
May 14 03:35:15.495658 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] No event matching network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d in dict_keys([('network-vif-plugged', 'b518c1d1-b5cf-41e3-a674-174d2211c99d')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received unexpected event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d for instance with vm_state building and task_state spawning.
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:15.496710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.497104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.497283 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.497452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No event matching network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a in dict_keys([('network-vif-plugged', '436c7406-82ac-4fb5-bcd8-5039846e810a')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:15.497617 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b1802ab8-cd71-4b80-a356-e0105495b5c2 req-c1bf25e8-4e17-486b-b9c0-0f47711f7938 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a for instance with vm_state building and task_state spawning.
May 14 03:35:15.560178 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:15.561431 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:15.563704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:15.567602 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Creating image(s)
May 14 03:35:15.567602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.567602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.567602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.567602 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:15.568919 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:15.571687 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:15.599421 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:15.599596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:15.599821 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No VIF found with MAC fa:16:3e:8e:f1:03, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:15.601113 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Using config drive
May 14 03:35:15.632653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:15.633759 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating image(s)
May 14 03:35:15.634122 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:35:15.634263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Ensure instance console log exists: /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:15.634543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.634811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.634954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.635649 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start _get_guest_xml network_info=[{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T03:30:33Z,direct_url=<?>,disk_format='qcow2',id=90dea114-1289-407a-a228-c9bda70c7ed1,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T03:30:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7ff50ead-8117-44fd-9be6-8ac88fa1f76d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'serial': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52'}, 'boot_index': 0, 'attachment_id': '228d3b89-5014-466c-9200-a867c6894bd1', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:15.639782 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 14 03:35:15.642339 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='90dea114-1289-407a-a228-c9bda70c7ed1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1500104163', uuid='7ff50ead-8117-44fd-9be6-8ac88fa1f76d'), owner=OwnerMeta(userid='4c2014044c024e0891b86095ab736fc1', username='tempest-ServerActionsV293TestJSON-1469734157-project-member', projectid='2c875214b84942f4b242e6a4213ba7ff', projectname='tempest-ServerActionsV293TestJSON-1469734157'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729715.6418529) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:15.645828 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:15.646110 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:15.649528 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:15.649813 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:15.651478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:15.651933 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T03:30:33Z,direct_url=<?>,disk_format='qcow2',id=90dea114-1289-407a-a228-c9bda70c7ed1,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T03:30:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:15.652139 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:15.652280 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:15.652460 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:15.652602 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:15.652778 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:15.652997 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:15.653140 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:15.653297 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:15.653457 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:15.653650 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:15.654697 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ff50ead-8117-44fd-9be6-8ac88fa1f76d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:15.665464 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:15.666170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.666699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.667225 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:15.673692 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:15.674089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:15.691359 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:15.754667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:15.755391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:15.800973 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk 1073741824" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:15.801489 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.135s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.801910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:15.862095 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:15.866425 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729715.8660028, b1ab08ef-80e1-42ea-8257-1a8d5bf62105 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:15.866599 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] VM Paused (Lifecycle Event)
May 14 03:35:15.891368 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:15.893149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:15.893678 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:35:15.895375 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:15.975007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:15.975903 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Cannot resize image /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:35:15.976417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:35:15.976671 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Ensure instance console log exists: /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:15.977365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:15.977731 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:15.977949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:15.988184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:15.990668 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:15.990668 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:15.990668 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:16.110536 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:16.173357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:35:16.173689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:16.173819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:16.174157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:16.174330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:35:16.191806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:16.192492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:16.192947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:16.193189 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:16.193597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:16.193782 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:16.205049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:16.205049 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:16.213726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:16.213726 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:16.220450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52] added
May 14 03:35:16.220450 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:16.220450 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:16.220450 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:16.220450 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:16.220450 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:16.220450 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:16.220806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:16.220893 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:16.221063 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:16.226984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52] added
May 14 03:35:16.226984 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:16.226984 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:16.226984 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:16.226984 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:16.226984 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:16.226984 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:16.227197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:16.227384 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:16.227550 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:16.234634 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b38d1b2fe1e04b09af7f4ddf5440e24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346418886705456e9de817c5a6473e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:16.257430 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Creating config drive at /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config
May 14 03:35:16.262592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd77vca92 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:16.309280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd77vca92" returned: 0 in 0.046s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:16.371760 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:16.381140 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:16.394931 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1c5ea43-5e7a-4826-8c9c-a4351c2b84b9 req-acffcd9f-1113-4a0f-a292-80760b650e2d service nova] Releasing lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:16.399096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquired lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:16.399773 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:16.492852 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:16.739798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:16.765587 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully created port: ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:16.769233 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:16.872885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:16.884784 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:35:16.998705 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:17.107384 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:17.108803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:17.112567 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:17.114080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:17.137499 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:17.222037 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:17.228137 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:17.235427 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:17.235427 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:17.242354 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:17.242354 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.256825 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:17.256825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.258083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.262752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:17.262752 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:17.262752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:17.262752 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:17.262752 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:35:17.262752 np0000000741 nova-compute[97948]: 
May 14 03:35:17.267062 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:17.267062 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:17.269658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:35:17.269658 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:17.269658 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:35:17.269658 np0000000741 nova-compute[97948]: 
May 14 03:35:17.286684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260]
May 14 03:35:17.286684 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260] successful.
May 14 03:35:17.286684 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.296108 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:17.296108 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:17.296108 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:17.296698 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:17.301109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.308959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260]
May 14 03:35:17.308959 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260] successful.
May 14 03:35:17.308959 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.316514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.316514 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.316514 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:17.316801 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.316801 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.316801 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:17.317350 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:17.317514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:17.317967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] HCTL ('7', '-', '-', 0) found on session 25 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:17.318109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:17.323589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:17.335695 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully created port: 627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:17.337158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.337158 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.337158 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:17.338430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.338430 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:17.338430 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:17.339721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:17.339923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:17.340611 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] HCTL ('8', '-', '-', 0) found on session 26 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:17.340805 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:17.341268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching for a device in session 25 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:17.341536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:17.360568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Searching for a device in session 26 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:17.360755 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:17.449896 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0008064170001489401 future=<Future at 0x79d0b84ae570 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:17.449896 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:17.450544 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Emitting event <LifecycleEvent: 1778729702.448745, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:17.450732 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Stopped (Lifecycle Event)
May 14 03:35:17.462804 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating instance_info_cache with network_info: [{"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:17.802938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:17.803323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:17.803323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:17.803451 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:35:17.861948 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729717.8615642, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:17.862080 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] VM Started (Lifecycle Event)
May 14 03:35:17.898671 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully created port: d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:17.964614 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:17.969510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Releasing lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:17.970013 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance network_info: |[{"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:35:17.972285 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Start _get_guest_xml network_info=[{"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:17.974031 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:17.975462 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1274014777', uuid='3defa392-75f0-4f24-b15d-d14ec40200cf'), owner=OwnerMeta(userid='53104358366841619575ce8b9b680e01', username='tempest-SnapshotDataIntegrityTests-596615631-project-member', projectid='817445e1e7da4d278a96c6cdd6c14c0e', projectname='tempest-SnapshotDataIntegrityTests-596615631'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729717.9750881) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:17.976328 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:17.976747 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:17.977333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:17.977540 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:17.978633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:17.979068 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:17.979257 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:17.979418 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:17.979585 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:17.979754 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:17.979882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:17.980093 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:17.980237 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:17.980397 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:17.980546 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:17.980747 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:17.997035 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1274014777',display_name='tempest-SnapshotDataIntegrityTests-server-1274014777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-snapshotdataintegritytests-server-1274014777',id=14,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL863LVRDnKVJbAe3wuwW6qULDc/xnW/kGqo/qVXzO/hELZb0ydoy32qfZTzlvGBQRIrFErqY76jBgdk8Q+e/4LyIABVoXCXEHyOGfAtwxUnLDmKZ02Jdq/mAX9IPuU+w==',key_name='tempest-keypair-1105384263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='817445e1e7da4d278a96c6cdd6c14c0e',ramdisk_id='',reservation_id='r-8491v06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-596615631',owner_user_name='tempest-SnapshotDataIntegrityTests-596615631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53104358366841619575ce8b9b680e01',uuid=3defa392-75f0-4f24-b15d-d14ec40200cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:17.997286 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converting VIF {"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:17.997992 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:17.999070 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'pci_devices' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:18.009176 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:18.119624 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:18.121602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:18.121870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:18.122890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:18.122890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] No waiting events found dispatching network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:18.122890 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received unexpected event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d for instance with vm_state building and task_state spawning.
May 14 03:35:18.122890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:18.122890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:18.123144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:18.123144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:18.123144 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Processing event network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:18.123296 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:18.123459 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:18.123696 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:18.124487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:18.124723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:18.124853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] No waiting events found dispatching network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:18.124981 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received unexpected event network-vif-plugged-b518c1d1-b5cf-41e3-a674-174d2211c99d for instance with vm_state building and task_state spawning.
May 14 03:35:18.125092 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:18.125237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:18.125303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:18.125443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:18.126110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d5e65bd-78b3-425e-aceb-54c38d505a41 req-e528b6f1-f7ce-4cb6-91c7-7187e18e739c service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Processing event network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:18.126854 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:18.130868 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:18.134654 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:18.137983 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance spawned successfully.
May 14 03:35:18.138323 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance spawned successfully.
May 14 03:35:18.139666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:18.140747 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:18.194017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:35:18.297575 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:18.347085 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully created port: 643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:18.365258 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:18.369269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:18.501827 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <uuid>3defa392-75f0-4f24-b15d-d14ec40200cf</uuid>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <name>instance-0000000e</name>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1274014777</nova:name>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:17</nova:creationTime>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:user uuid="53104358366841619575ce8b9b680e01">tempest-SnapshotDataIntegrityTests-596615631-project-member</nova:user>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:project uuid="817445e1e7da4d278a96c6cdd6c14c0e">tempest-SnapshotDataIntegrityTests-596615631</nova:project>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         <nova:port uuid="620119d0-d806-4e90-b497-d5103f24a42d">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="serial">3defa392-75f0-4f24-b15d-d14ec40200cf</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="uuid">3defa392-75f0-4f24-b15d-d14ec40200cf</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.config"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:06:b4:3a"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <target dev="tap620119d0-d8"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/console.log" append="off"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:18.501827 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Preparing to wait for external event network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1274014777',display_name='tempest-SnapshotDataIntegrityTests-server-1274014777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-snapshotdataintegritytests-server-1274014777',id=14,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL863LVRDnKVJbAe3wuwW6qULDc/xnW/kGqo/qVXzO/hELZb0ydoy32qfZTzlvGBQRIrFErqY76jBgdk8Q+e/4LyIABVoXCXEHyOGfAtwxUnLDmKZ02Jdq/mAX9IPuU+w==',key_name='tempest-keypair-1105384263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='817445e1e7da4d278a96c6cdd6c14c0e',ramdisk_id='',reservation_id='r-8491v06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-596615631',owner_user_name='tempest-SnapshotDataIntegrityTests-596615631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53104358366841619575ce8b9b680e01',uuid=3defa392-75f0-4f24-b15d-d14ec40200cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converting VIF {"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:18.505243 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:18.505739 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:18.506592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:18.506592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:18.506592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:18.508432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:18.508432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd15f31fd-2af3-5f3e-bec3-c98e9f3a2cca', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:18.510912 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:18.515846 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:18.516154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap620119d0-d8, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:18.520459 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Booting with volume 1232e137-9536-4dfe-8d48-86b187100996 at /dev/vda
May 14 03:35:18.521657 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap620119d0-d8, col_values=(('qos', UUID('1b2de75b-fd8e-436b-97c5-31ed5c0069bb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:18.522533 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap620119d0-d8, col_values=(('external_ids', {'iface-id': '620119d0-d806-4e90-b497-d5103f24a42d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b4:3a', 'vm-uuid': '3defa392-75f0-4f24-b15d-d14ec40200cf'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:18.526562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:18.530040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:18.531766 np0000000741 nova-compute[97948]: INFO os_vif [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8')
May 14 03:35:18.594082 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:18.609655 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:35:18.635829 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:18.662467 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.663068 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.663502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.663885 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.664346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.664651 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.673589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.675143 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.675574 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.675892 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.676220 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.676488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:18.680946 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:35:18.681952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:35:18.695381 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:35:18.696947 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe56:4186', 'fe80::4459:f1ff:fecb:eba0', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151'] 
May 14 03:35:18.697916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:35:18.697916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:35:18.698216 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:18.698620 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating existing volume attachment record: 579cfb70-3137-4b73-9301-d70a441d2ad9 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:35:18.829960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:18.875357 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:35:18.876325 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729718.8755019, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:18.876325 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] VM Paused (Lifecycle Event)
May 14 03:35:18.938960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:18.940376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:18.968966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.051990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.056206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:19.172165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.173120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:19.198065 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Took 7.50 seconds to spawn the instance on the hypervisor.
May 14 03:35:19.203742 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:19.206112 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Took 10.64 seconds to spawn the instance on the hypervisor.
May 14 03:35:19.206740 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:19.225202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Found WWN 3300000004fd344d4 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:35:19.227961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:19.228328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '3300000004fd344d4', 'path': '/dev/dm-0', 'multipath_id': '3300000004fd344d4'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:19.228540 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004fd344d4', 'path': '/dev/dm-0', 'multipath_id': '3300000004fd344d4'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:35:19.284558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.291677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:19.391445 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:19.396009 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729719.3956335, b1ab08ef-80e1-42ea-8257-1a8d5bf62105 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:19.396140 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] VM Resumed (Lifecycle Event)
May 14 03:35:19.409902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.410441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:19.498380 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully created port: f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:19.505205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.508056 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:19.510894 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:19.561336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:19.561776 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=14241MB free_disk=74.64892196655273GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:35:19.562454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:19.562741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:19.720534 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Took 13.09 seconds to build instance.
May 14 03:35:19.733951 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Took 16.18 seconds to build instance.
May 14 03:35:19.738260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1500104163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:20Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:19.738767 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:19.741104 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:19.746037 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <uuid>7ff50ead-8117-44fd-9be6-8ac88fa1f76d</uuid>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <name>instance-00000009</name>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1500104163</nova:name>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:15</nova:creationTime>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:image uuid="90dea114-1289-407a-a228-c9bda70c7ed1">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:user uuid="4c2014044c024e0891b86095ab736fc1">tempest-ServerActionsV293TestJSON-1469734157-project-member</nova:user>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:project uuid="2c875214b84942f4b242e6a4213ba7ff">tempest-ServerActionsV293TestJSON-1469734157</nova:project>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid="90dea114-1289-407a-a228-c9bda70c7ed1"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         <nova:port uuid="85ebf74d-7491-40f6-8d0b-502c1e3b6e7d">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="serial">7ff50ead-8117-44fd-9be6-8ac88fa1f76d</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="uuid">7ff50ead-8117-44fd-9be6-8ac88fa1f76d</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <alias name="ua-f4f4fe53-19a1-4009-b32b-4dc114f19b52"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <serial>f4f4fe53-19a1-4009-b32b-4dc114f19b52</serial>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b5:d8:92"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <target dev="tap85ebf74d-74"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/console.log" append="off"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:19.746037 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:19.750149 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1500104163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:20Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:19.750149 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:19.750614 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:19.751456 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:19.753632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.753632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:19.753632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:19.755084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.755084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f8e8365-0aac-5a5e-b1cf-be6166c65601', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:19.757284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.758686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:19.762789 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.769166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.769476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ebf74d-74, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:19.770022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ebf74d-74, col_values=(('qos', UUID('2f5e6b3e-d75c-4236-b0a2-e4ad280cc59c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:19.770695 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ebf74d-74, col_values=(('external_ids', {'iface-id': '85ebf74d-7491-40f6-8d0b-502c1e3b6e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:d8:92', 'vm-uuid': '7ff50ead-8117-44fd-9be6-8ac88fa1f76d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:19.772244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.775510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:19.787769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:19.790198 np0000000741 nova-compute[97948]: INFO os_vif [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74')
May 14 03:35:19.901526 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:19.903567 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:20.065699 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:20.065699 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:20.065699 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No VIF found with MAC fa:16:3e:06:b4:3a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:20.066196 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Using config drive
May 14 03:35:20.163031 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:20.222104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ceef973-dcb3-4850-bbc9-82b0e9467353 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.601s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:20.235409 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:20.237115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.691s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:20.237404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:20.238042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:20.238042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:20.238042 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:20.238239 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1c3dd0ea-8e3e-4caa-81f2-6821860021db req-9b9d9815-8c4d-4151-8ee8-6e4a42e146f8 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-plugged-436c7406-82ac-4fb5-bcd8-5039846e810a for instance with vm_state active and task_state None.
May 14 03:35:20.346952 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Booting with volume b0f8f542-acd2-44d3-a5a9-660b891fc660 at /dev/vdb
May 14 03:35:20.406267 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729720.4058607, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:20.406523 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] VM Resumed (Lifecycle Event)
May 14 03:35:20.409487 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:20.430581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:35:20.456663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:20.499032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:35:20.499032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:35:20.513748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:35:20.515890 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe56:4186', 'fe80::4459:f1ff:fecb:eba0', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151'] 
May 14 03:35:20.516460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:35:20.516708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:35:20.517097 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:20.517269 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating existing volume attachment record: 1ee2347c-6e07-4eeb-939a-7ff6133bcbcc {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:35:20.579669 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:20.655534 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7ff50ead-8117-44fd-9be6-8ac88fa1f76d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.655700 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.655779 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance b1ab08ef-80e1-42ea-8257-1a8d5bf62105 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.655867 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.655954 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3defa392-75f0-4f24-b15d-d14ec40200cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.656030 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:35:20.656212 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:35:20.656336 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:35:19 up 27 min,  2 users,  load average: 8.81, 4.79, 2.25\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_rebuild_spawning': '1', 'num_os_type_None': '6', 'num_proj_2c875214b84942f4b242e6a4213ba7ff': '1', 'io_workload': '2', 'num_task_None': '3', 'num_proj_20e394a2d53341d59d512810b2a3dea2': '1', 'num_proj_540edf423c7349798850fccbd7415216': '1', 'num_proj_0bf8c09511e44fecb39453337950bdf2': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_817445e1e7da4d278a96c6cdd6c14c0e': '1', 'num_task_block_device_mapping': '1', 'num_proj_346418886705456e9de817c5a6473e49': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:35:20.916873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:20.918754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:21.045326 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:21.045326 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:21.176191 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:21.309795 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:21.310019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:21.310019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] No VIF found with MAC fa:16:3e:b5:d8:92, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:21.310439 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Using config drive
May 14 03:35:21.375233 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Creating config drive at /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.config
May 14 03:35:21.382663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzgjlz97 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:21.440340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzgjlz97" returned: 0 in 0.057s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:21.547484 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:21.627421 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:21.727847 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:21.727847 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-ab798e2b-be0a-492d-9b09-98a7b7225055. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:21.727847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:21.727847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:21.727847 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:21.813555 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7ff50ead-8117-44fd-9be6-8ac88fa1f76d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:22.021186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.056142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.059830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.063080 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:35:22.063080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.499s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:22.065278 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:35:22.163739 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Booting with volume 71342ded-3d4b-4074-8ce7-29512e63abfc at /dev/vdc
May 14 03:35:22.167558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.237853 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:22.240101 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:22.260865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:35:22.289213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:22.321925 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Object Instance<7ff50ead-8117-44fd-9be6-8ac88fa1f76d> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:35:22.322241 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lazy-loading 'keypairs' on Instance uuid 7ff50ead-8117-44fd-9be6-8ac88fa1f76d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:22.335956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:35:22.336817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:35:22.348695 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:35:22.349101 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe56:4186', 'fe80::4459:f1ff:fecb:eba0', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb'] 
May 14 03:35:22.349390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:35:22.349482 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:35:22.351753 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:22.351753 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating existing volume attachment record: aee308d8-bdd7-413c-ac17-48add0a5612f {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:35:22.469764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.478621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.483367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.510425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee1d15fe-c89d-4b6f-8ee3-3d0269371974 req-4410bbc0-4dbf-483b-9ad2-c354bd35b7ae service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:22.510717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee1d15fe-c89d-4b6f-8ee3-3d0269371974 req-4410bbc0-4dbf-483b-9ad2-c354bd35b7ae service nova] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:22.510836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee1d15fe-c89d-4b6f-8ee3-3d0269371974 req-4410bbc0-4dbf-483b-9ad2-c354bd35b7ae service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:22.510883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee1d15fe-c89d-4b6f-8ee3-3d0269371974 req-4410bbc0-4dbf-483b-9ad2-c354bd35b7ae service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:22.511060 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee1d15fe-c89d-4b6f-8ee3-3d0269371974 req-4410bbc0-4dbf-483b-9ad2-c354bd35b7ae service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Processing event network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:22.514045 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.521804 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:22.552048 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:22.553985 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:22.554228 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:22.554412 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:35:22.554547 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:35:22.556191 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.22 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:35:22.829152 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Object Instance<7ff50ead-8117-44fd-9be6-8ac88fa1f76d> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:35:22.835144 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 14 03:35:22.915992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:23.238082 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729723.2373676, 3defa392-75f0-4f24-b15d-d14ec40200cf => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:23.240505 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:23.241056 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] VM Started (Lifecycle Event)
May 14 03:35:23.245344 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:23.249699 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance spawned successfully.
May 14 03:35:23.251228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:23.266874 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: 7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:23.299300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:23.314136 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:23.722857 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Creating config drive at /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config
May 14 03:35:23.733277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo0f7wj6f {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:23.752947 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:23.770126 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:23.780228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.780686 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:23.784845 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.788399 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.788978 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.789378 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.790753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:23.801313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo0f7wj6f" returned: 0 in 0.069s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:23.856672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:23.857256 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-7d31361a-05f8-48b4-86b6-a308841519b6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:23.857989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:24.287250 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:35:24.287899 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729724.2872589, 3defa392-75f0-4f24-b15d-d14ec40200cf => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:24.287899 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] VM Paused (Lifecycle Event)
May 14 03:35:24.290093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df20327e-c0f3-447e-a1aa-5a9f7441f626 req-d132da92-50ea-414f-aa55-7a5f8339d65b service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:24.291937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:24.291937 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port 7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:24.305128 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Took 8.74 seconds to spawn the instance on the hypervisor.
May 14 03:35:24.305128 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:24.326693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:24.326693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:24.326693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:24.326693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:24.326693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:24.329949 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Terminating instance
May 14 03:35:24.374498 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.408356 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.521481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.524203 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:24.525674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:24.528884 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Creating image(s)
May 14 03:35:24.529669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:35:24.533564 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Ensure instance console log exists: /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:24.533564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:24.533564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:24.533564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:24.719095 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:24.719361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:24.719590 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:24.719777 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:24.719960 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] No waiting events found dispatching network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:24.720176 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received unexpected event network-vif-plugged-620119d0-d806-4e90-b497-d5103f24a42d for instance with vm_state active and task_state None.
May 14 03:35:24.720286 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-changed-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:24.720434 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing instance network info cache due to event network-changed-436c7406-82ac-4fb5-bcd8-5039846e810a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:24.720615 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:24.720754 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:24.720893 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing network info cache for port 436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:24.775724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.793048 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:24.794349 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:24.799323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.811276 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729724.8098502, 3defa392-75f0-4f24-b15d-d14ec40200cf => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:24.811276 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] VM Resumed (Lifecycle Event)
May 14 03:35:24.814734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.834107 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Took 16.29 seconds to build instance.
May 14 03:35:24.837104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:35:24.839820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.869808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.874621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.899250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:24.950609 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: 65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:24.995939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.024801 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.027774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.137185 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:25.175827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.184889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.214078 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Instance destroyed successfully.
May 14 03:35:25.215668 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lazy-loading 'resources' on Instance uuid b1ab08ef-80e1-42ea-8257-1a8d5bf62105 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:25.223840 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:25.318617 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:25.340511 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:25.344317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-feb6bb38-59ad-413e-82dc-2bd7dc28a6ba tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.810s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:25.415862 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.642929 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:25.644694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:25.649162 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance spawned successfully.
May 14 03:35:25.651299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:25.665316 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:25.717916 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138158398',display_name='tempest-VolumesActionsTest-instance-138158398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-138158398',id=12,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='540edf423c7349798850fccbd7415216',ramdisk_id='',reservation_id='r-4xki1y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-329536730',owner_user_name='tempest-VolumesActionsTest-329536730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data=None,user_id='5965648eb844445ba39309f715cae8fa',uuid=b1ab08ef-80e1-42ea-8257-1a8d5bf62105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:35:25.717916 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converting VIF {"id": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "address": "fa:16:3e:56:41:86", "network": {"id": "08ced755-59b3-45fe-be72-29d535bb6691", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1054935453-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "540edf423c7349798850fccbd7415216", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb518c1d1-b5", "ovs_interfaceid": "b518c1d1-b5cf-41e3-a674-174d2211c99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:25.722119 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:25.722546 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:35:25.725001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.725001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb518c1d1-b5, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:25.727713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.728593 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:25.729264 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:25.729430 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60ee30cc-269d-4235-8e8f-199f1ddfc8e6) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:25.731412 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:25.734241 np0000000741 nova-compute[97948]: INFO os_vif [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:41:86,bridge_name='br-int',has_traffic_filtering=True,id=b518c1d1-b5cf-41e3-a674-174d2211c99d,network=Network(08ced755-59b3-45fe-be72-29d535bb6691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb518c1d1-b5')
May 14 03:35:25.734631 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Deleting instance files /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105_del
May 14 03:35:25.735425 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Deletion of /opt/stack/data/nova/instances/b1ab08ef-80e1-42ea-8257-1a8d5bf62105_del complete
May 14 03:35:25.846553 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999723130999882 future=<Future at 0x79d0b8244590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:25.846553 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729725.8463302, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:25.846729 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Resumed (Lifecycle Event)
May 14 03:35:25.847846 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99866787499991 future=<Future at 0x79d0b8244590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:25.847846 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998532737000005 future=<Future at 0x79d0b8244590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:26.160948 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.160948 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.161237 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.161530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.161874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.162439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:26.167305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a3ad2f9-dda8-44d7-a942-3c2ef67caded req-fea8112d-a94e-4e10-a67b-3bdbcc858454 service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:26.246699 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 03:35:26.247293 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:35:26.248845 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:35:26.248845 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:35:26.248845 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:26.352816 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:26.359121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:26.426302 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: 627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:26.597503 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:26.668416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:26.762435 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:26.780229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-changed-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:26.780440 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Refreshing instance network info cache due to event network-changed-620119d0-d806-4e90-b497-d5103f24a42d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:26.780697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] Acquiring lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:26.780818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] Acquired lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:26.780967 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Refreshing network info cache for port 620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:26.854320 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received unexpected event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with vm_state active and task_state None.
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-65705ae3-abe6-46c8-8cd9-00e9ff42b480. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:26.856269 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port 65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:26.862429 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 14 03:35:26.863564 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729726.8625176, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:26.864322 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Started (Lifecycle Event)
May 14 03:35:27.180760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:27.180965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:27.181230 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97948) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 14 03:35:27.284984 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:27.359898 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:27.368405 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:27.375566 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:27.382219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:27.690917 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:27.810531 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:28.190411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3db4917-27ff-4de5-8688-1a874a92b3d5 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.009s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:28.301973 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:28.313994 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Took 2.07 seconds to deallocate network for instance.
May 14 03:35:28.695249 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:28.802275 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updated VIF entry in instance network info cache for port 436c7406-82ac-4fb5-bcd8-5039846e810a. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:35:28.808452 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:28.828904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:28.828904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:28.922621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:28.923808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:28.932079 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5397d28f-175a-4132-aab4-91da59469294 req-1db28522-3d94-4304-80bd-4864ba409347 service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-deleted-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:28.957537 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:29.086277 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:29.286923 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:29.300793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:29.301180 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:29.311631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29c43525-369e-4084-ac9b-4703be5f9565 req-f67e6e9f-663d-4ef6-a8ae-7e064f73f369 service nova] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:29.429790 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received unexpected event network-vif-plugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with vm_state active and task_state None.
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:29.461817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:29.462059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] No waiting events found dispatching network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:29.462086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:29.462280 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:29.464009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:29.464194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:29.464344 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] No waiting events found dispatching network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Received event network-vif-unplugged-b518c1d1-b5cf-41e3-a674-174d2211c99d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-627a44d5-69b7-409d-b04d-d73bde9a4c24. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:29.467295 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port 627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:29.595713 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updated VIF entry in instance network info cache for port 620119d0-d806-4e90-b497-d5103f24a42d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:35:29.595713 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating instance_info_cache with network_info: [{"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:29.804788 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:29.935131 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Ignoring supplied device name: /dev/vdb
May 14 03:35:29.968904 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:30.101254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c2856e20-7f7c-4952-94dd-4af151abc6ec req-bf090b2e-80d1-46cc-9323-7f4f989b7275 service nova] Releasing lock "refresh_cache-3defa392-75f0-4f24-b15d-d14ec40200cf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:30.166960 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: 643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:30.314510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.486s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:30.389082 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Deleted allocations for instance b1ab08ef-80e1-42ea-8257-1a8d5bf62105
May 14 03:35:30.437153 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:30.494253 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:30.516044 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:30.690045 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:30.732271 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:31.046184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:31.046184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-d7e11d12-da95-4f0b-8c38-d786307636f6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:31.046184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:31.192406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6e061c7-e780-45c4-8a2a-c5ce601886bf req-dda1bfdc-10ec-4c11-9b02-68b4197230ad service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:31.192946 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:31.193195 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:31.304141 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Successfully updated port: f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:31.401403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-aa2f667b-d709-4441-85e0-a913089da0fb tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Lock "b1ab08ef-80e1-42ea-8257-1a8d5bf62105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.076s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:31.512820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:31.558292 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:31.558579 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:31.558872 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Attaching volume fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 to /dev/vdb
May 14 03:35:31.620578 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:31.638279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:35:31.666107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:31.701868 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:31.712395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:35:31.713049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:35:31.721794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:35:31.724406 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:feb5:d892', 'fe80::ec7e:ff:fe82:25e9'] 
May 14 03:35:31.724406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:35:31.724406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:35:31.727667 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:31.727667 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating existing volume attachment record: b9c021fc-8322-4ba6-9d1f-430d07c7e292 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:35:31.807182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:31.838218 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:32.100147 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:32.311147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:35:32.311147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:32.311147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:32.311147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:32.311147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:35:32.331225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:32.331748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:32.332181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:32.332453 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:32.332787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:32.332972 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:32.345202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:32.345202 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:32.352211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:32.352211 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0] added
May 14 03:35:32.360717 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:32.360717 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:32.360717 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:32.365974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0] added
May 14 03:35:32.365974 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:32.365974 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:32.365974 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:32.365974 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:32.365974 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:32.365974 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:32.366257 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:32.366789 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:32.366789 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:32.602861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:32.603222 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:32.603222 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-643b4c43-b59a-4d6c-a242-5832a584a375. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:32.603329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:32.603447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:32.603585 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port 643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:33.107074 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:33.133076 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:33.134788 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-f5053041-b640-4476-bb1b-eaa08f9cc4ef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:33.135236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:33.307874 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:33.359025 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:33.362596 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:33.367428 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:33.373165 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:33.373165 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:33.385328 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:33.385328 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.391975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.405305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.411538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.411538 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.411538 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:33.411940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.411940 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.411940 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:33.424756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.424756 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.424756 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:33.424931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.424931 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.424931 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:33.442624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.50.100,3260]
May 14 03:35:33.442624 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.50.100,3260] successful.
May 14 03:35:33.442624 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.456106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.465820 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.40.100,3260]
May 14 03:35:33.465820 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.40.100,3260] successful.
May 14 03:35:33.465820 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.478068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.478068 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.478068 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.478068 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.478068 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:33.478374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.478374 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.478374 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.478374 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.478374 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:33.478509 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:33.478596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:33.479720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] HCTL ('9', '-', '-', 0) found on session 27 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:33.479720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:33.484505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:33.502849 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:33.503567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:33.503567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:33.504265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] HCTL ('10', '-', '-', 0) found on session 28 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:33.504489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:33.505442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:33.530472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 28 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:33.530630 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:33.579398 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:33.800028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:34.082631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95f089df-ae89-4e75-aa74-0faec220f6bb req-dcd3b124-324b-4dc2-ac97-5381fd1f9629 service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:34.083179 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:34.083375 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:34.422096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:34.506388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:34.506631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:34.678905 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:34.894774 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:35.297318 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:35.351626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found WWN 330000000fb01bcf3 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:35:35.352012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:35.353362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000fb01bcf3', 'path': '/dev/dm-3', 'multipath_id': '330000000fb01bcf3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:35.354939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fb01bcf3', 'path': '/dev/dm-3', 'multipath_id': '330000000fb01bcf3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:35:35.357398 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:35.687418 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:35.733058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:35.855032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:35.855032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:35.860908 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Attempting to attach volume fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:35:35.863408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:   <alias name="ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0"/>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:   <serial>fdcd6a6a-129a-49fe-bdfc-8790ca150fc0</serial>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]: </disk>
May 14 03:35:35.863408 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:35:36.117533 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:36.357311 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:36.490189 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:36.939400 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:36.953810 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:37.064562 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:37.064774 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:37.068483 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:37.068683 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Claim successful on node np0000000741
May 14 03:35:37.307391 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:37.467573 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:37.560674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:37.560674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:37.560674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:37.560674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No VIF found with MAC fa:16:3e:61:62:07, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:37.969893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:37.970532 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance network_info: |[{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:35:37.970844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:37.971013 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:37.972713 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Start _get_guest_xml network_info=[{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49558f8d-c20a-4fce-80c6-7959b0ade9ff', 'attached_at': '', 'detached_at': '', 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'serial': '1232e137-9536-4dfe-8d48-86b187100996'}, 'boot_index': 0, 'attachment_id': '579cfb70-3137-4b73-9301-d70a441d2ad9', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49558f8d-c20a-4fce-80c6-7959b0ade9ff', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'serial': 'b0f8f542-acd2-44d3-a5a9-660b891fc660'}, 'boot_index': 1, 'attachment_id': '1ee2347c-6e07-4eeb-939a-7ff6133bcbcc', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49558f8d-c20a-4fce-80c6-7959b0ade9ff', 'attached_at': '', 'detached_at': '', 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'serial': '71342ded-3d4b-4074-8ce7-29512e63abfc'}, 'boot_index': 2, 'attachment_id': 'aee308d8-bdd7-413c-ac17-48add0a5612f', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:37.975365 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:37.978741 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-228783713', uuid='49558f8d-c20a-4fce-80c6-7959b0ade9ff'), owner=OwnerMeta(userid='b38d1b2fe1e04b09af7f4ddf5440e24a', username='tempest-TaggedBootDevicesTest_v242-1762907854-project-member', projectid='346418886705456e9de817c5a6473e49', projectname='tempest-TaggedBootDevicesTest_v242-1762907854'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729737.9775527) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:37.980754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:37.981700 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:37.983241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:37.983478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:37.984401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:37.984685 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:37.985928 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:37.986378 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:37.986544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:37.986664 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:37.988554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:37.998190 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:35:37.998402 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:38.000545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:38.142730 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Refreshing inventories for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 03:35:38.191310 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Updating ProviderTree inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 03:35:38.191310 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:35:38.254761 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Refreshing aggregate associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, aggregates: None {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 03:35:38.308683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:38.318271 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Refreshing trait associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_MIPSEL,COMPUTE_NODE,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_AARCH64,COMPUTE_ARCH_RISCV64 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 03:35:38.474948 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:38.551298 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.552s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:38.551352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:35:38.567612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:38.570778 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:38.570778 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:38.575259 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:38.576722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:38.578488 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:38.590897 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:38.590897 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:38.600225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:38.600225 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:38.610845 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996] added
May 14 03:35:38.610845 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:38.610845 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:38.610845 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:38.610845 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:38.610845 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:38.610845 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:38.611053 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:38.611928 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:38.611928 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996] added
May 14 03:35:38.614914 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:38.614914 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:38.614914 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0378(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:38.615333 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:38.754974 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:38.755289 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:38.944234 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:39.145470 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updated VIF entry in instance network info cache for port f5053041-b640-4476-bb1b-eaa08f9cc4ef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:35:39.146078 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:39.160251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34a8edaa-3dcc-46d5-97dc-03bbf4151441 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.601s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:39.258082 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:39.615466 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:39.617446 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:39.631825 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:39.631825 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:39.640301 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:39.640301 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.650024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.650999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f247e191-61ad-4247-8b56-a640a10c3086 req-ef8bde8c-e6a5-4526-a0c4-959e8a82f1e9 service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:39.662042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.676928 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.677241 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.684431 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.685292 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:39.721819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.50.100,3260]
May 14 03:35:39.721819 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.50.100,3260] successful.
May 14 03:35:39.721819 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.730083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.40.100,3260]
May 14 03:35:39.730083 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.40.100,3260] successful.
May 14 03:35:39.730083 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.737480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.745441 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.759957 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.760333 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:39.760587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:39.760587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:39.762267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('13', '-', '-', 0) found on session 31 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:39.762267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:39.768077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.703s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:39.768922 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:39.773483 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:39.773483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:39.776078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('14', '-', '-', 0) found on session 32 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:39.776078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:39.789132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 31 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:39.789366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:39.800518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 32 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:39.800518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:40.277843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:40.278342 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:40.278342 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:40.278806 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:40.401359 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe2ffc6cce044f7ad75df57827bc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6177683ef84349e5a26042f334b26ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:40.570202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:35:40.735709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:40.777484 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:40.846501 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004494429999795102 future=<Future at 0x79d0b8244590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:40.846691 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:35:40.847921 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778729725.845919, b1ab08ef-80e1-42ea-8257-1a8d5bf62105 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:40.848347 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] VM Stopped (Lifecycle Event)
May 14 03:35:41.030806 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Successfully created port: cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:41.283416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:41.353616 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-233e5c19-ffb2-4c8b-bf63-fba5ac2189c8 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: b1ab08ef-80e1-42ea-8257-1a8d5bf62105] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:41.600900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Found WWN 330000000c52a1125 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:35:41.601286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:41.601526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== connect_volume: return (3602ms) {'type': 'block', 'scsi_wwn': '330000000c52a1125', 'path': '/dev/dm-5', 'multipath_id': '330000000c52a1125'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:41.601727 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c52a1125', 'path': '/dev/dm-5', 'multipath_id': '330000000c52a1125'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:35:41.815256 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Successfully updated port: cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:41.891701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-changed-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:41.891886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Refreshing instance network info cache due to event network-changed-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:41.892100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] Acquiring lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:41.892856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] Acquired lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:41.893015 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Refreshing network info cache for port cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:42.112166 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:35:42.112508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:42.112678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:42.301426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:42.302576 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:42.302886 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Creating image(s)
May 14 03:35:42.303459 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:42.303673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:42.304290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:42.304917 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:42.309619 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:42.310937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:42.331045 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:42.395466 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:42.398706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:42.399259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:42.399968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:42.400379 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:42.404343 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:42.404651 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:42.482788 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:42.488159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.079s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:42.488159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:42.547865 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk 1073741824" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:42.548591 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:42.548981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:42.644978 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:42.647472 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:35:42.647472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:42.698458 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:42.767160 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:42.768034 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Cannot resize image /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:35:42.768574 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:35:42.768744 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Ensure instance console log exists: /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:42.771347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:42.771584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:42.771721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:42.918223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:43.202144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-64258247-fb7b-4a92-b47d-21821f8053c8 req-d14373ec-f480-4d3d-aaa3-82cd0e238eec service nova] Releasing lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:43.203332 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:43.203332 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:43.309245 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:43.808359 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:43.988218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.873s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:43.988218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:35:44.006950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:44.006950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:44.007180 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:44.009619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:44.009619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:44.009619 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:44.022701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:44.022701 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:44.030129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:44.030129 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660] added
May 14 03:35:44.041774 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:44.041774 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:44.041774 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:44.056869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660] added
May 14 03:35:44.056869 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:44.056869 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:44.056869 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:44.056869 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:44.056869 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:44.056869 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:44.057209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:44.057209 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:44.057385 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:44.106622 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:44.429665 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Updating instance_info_cache with network_info: [{"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:44.931541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-42a1f2e8-804b-4703-ad8d-4ecf57fe737a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:44.931792 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance network_info: |[{"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:35:44.935072 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Start _get_guest_xml network_info=[{"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:35:44.942018 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:35:44.944345 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1033156099', uuid='42a1f2e8-804b-4703-ad8d-4ecf57fe737a'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729744.9428015) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:35:44.949663 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:35:44.951293 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:35:44.953876 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:35:44.953876 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:35:44.954570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:35:44.955251 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:35:44.955251 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:35:44.956550 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:35:44.956550 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:35:44.956550 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:35:44.956818 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:35:44.956893 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:35:44.957122 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:35:44.957447 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:35:44.957447 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:35:44.957608 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:35:44.977594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1033156099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1033156099',id=16,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-r67ofsql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:41Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=42a1f2e8-804b-4703-ad8d-4ecf57fe737a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:44.977834 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:44.978328 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:44.979119 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid 42a1f2e8-804b-4703-ad8d-4ecf57fe737a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:45.042959 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:45.061056 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:45.070555 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:45.070555 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:45.086110 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:45.086110 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.093280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.107626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.120089 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.120795 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.131174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:45.191029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.40.100,3260]
May 14 03:35:45.191029 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.40.100,3260] successful.
May 14 03:35:45.191029 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.199914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.50.100,3260]
May 14 03:35:45.199914 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.50.100,3260] successful.
May 14 03:35:45.199914 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.211669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.218838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.235501 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.236212 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:45.236212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:45.238654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('16', '-', '-', 0) found on session 34 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:45.239365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.245116 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:45.245480 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:45.245858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:45.245858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:45.247238 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('17', '-', '-', 0) found on session 35 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:45.247353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:45.284625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 34 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:45.284625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:45.284625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 35 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:45.284625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:45.483262 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <uuid>42a1f2e8-804b-4703-ad8d-4ecf57fe737a</uuid>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <name>instance-00000010</name>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1033156099</nova:name>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:44</nova:creationTime>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         <nova:port uuid="cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="serial">42a1f2e8-804b-4703-ad8d-4ecf57fe737a</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="uuid">42a1f2e8-804b-4703-ad8d-4ecf57fe737a</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.config"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:6e:ee:72"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <target dev="tapcf1d49cf-c9"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/console.log" append="off"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:45.483262 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:45.483262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Preparing to wait for external event network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1033156099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1033156099',id=16,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-r67ofsql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:41Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=42a1f2e8-804b-4703-ad8d-4ecf57fe737a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:45.486390 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:45.487462 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:45.487704 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.488594 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:45.489474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:45.490661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.491704 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d864c8f-fcff-5818-9f59-ac6c11e4b78f', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:45.491933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.493586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:45.495547 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.502322 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.503214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf1d49cf-c9, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:45.503214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf1d49cf-c9, col_values=(('qos', UUID('eeff8230-076e-4e4e-89ae-1d96056e1f51')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:45.507286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf1d49cf-c9, col_values=(('external_ids', {'iface-id': 'cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:ee:72', 'vm-uuid': '42a1f2e8-804b-4703-ad8d-4ecf57fe737a'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:45.507286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:45.514773 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:45.516918 np0000000741 nova-compute[97948]: INFO os_vif [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9')
May 14 03:35:46.010748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:35:46.730756 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:47.034113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Found WWN 330000000f553714b for multipath device dm-8 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:35:47.036670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:47.036670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== connect_volume: return (4922ms) {'type': 'block', 'scsi_wwn': '330000000f553714b', 'path': '/dev/dm-8', 'multipath_id': '330000000f553714b'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:47.036670 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f553714b', 'path': '/dev/dm-8', 'multipath_id': '330000000f553714b'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:35:47.051712 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:47.051820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:47.051954 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:6e:ee:72, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:47.052388 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Using config drive
May 14 03:35:47.549252 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:35:47.549547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:35:47.549744 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:47.551171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:47.551393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:35:47.565902 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:47.571118 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:47.572218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:47.573017 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:47.574511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:35:47.576103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:35:47.578727 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:47.590763 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:47.590763 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:47.599343 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:35:47.599343 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:47.609253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc] added
May 14 03:35:47.609253 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:47.609253 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:47.609253 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:47.609253 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:47.609253 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:47.609253 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:47.609624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:47.609624 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:47.609742 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:47.625427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc] added
May 14 03:35:47.625427 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:35:47.625427 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:47.625427 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:47.625427 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:35:47.625427 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:35:47.625427 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:47.625963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:35:47.626250 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0491(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:35:47.626506 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:35:47.826013 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Creating config drive at /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.config
May 14 03:35:47.830324 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpju5pg7oy {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:47.884674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpju5pg7oy" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:48.317114 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:48.480757 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:48.512916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:48.610704 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:35:48.627621 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:48.635598 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:48.635598 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.654389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:35:48.659664 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:35:48.659664 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.672287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.679117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.703027 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.704340 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.720174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:48.786738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.40.100,3260]
May 14 03:35:48.786738 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.40.100,3260] successful.
May 14 03:35:48.786738 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.794699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.50.100,3260]
May 14 03:35:48.794699 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.50.100,3260] successful.
May 14 03:35:48.794699 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.801259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.818217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.834467 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.835310 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.263s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:48.835310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:48.841813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('18', '-', '-', 0) found on session 36 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:48.841813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.851260 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d82521-c2a6-4c13-b220-7402fff06bfd (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc64b512-098d-4ad8-bfb0-19b0785fe9b7 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:35:48.851708 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:35:48.851999 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.276s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:48.851999 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:35:48.856058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] HCTL ('19', '-', '-', 0) found on session 37 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:35:48.858755 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:35:48.874722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 36 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:48.874722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:48.908624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Searching for a device in session 37 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:35:48.910379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:35:48.925021 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3e91412d-8e05-4ada-b2a4-98f6e6033d4b req-87dc0473-c50b-4584-b345-2c9e2c38d339 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:48.925209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3e91412d-8e05-4ada-b2a4-98f6e6033d4b req-87dc0473-c50b-4584-b345-2c9e2c38d339 service nova] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:48.925440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3e91412d-8e05-4ada-b2a4-98f6e6033d4b req-87dc0473-c50b-4584-b345-2c9e2c38d339 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:48.937132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3e91412d-8e05-4ada-b2a4-98f6e6033d4b req-87dc0473-c50b-4584-b345-2c9e2c38d339 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:48.937132 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3e91412d-8e05-4ada-b2a4-98f6e6033d4b req-87dc0473-c50b-4584-b345-2c9e2c38d339 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Processing event network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:48.982802 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:49.006218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:49.026802 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:49.576618 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:35:49.994271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:49.995244 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729749.9946818, 42a1f2e8-804b-4703-ad8d-4ecf57fe737a => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:49.995439 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] VM Started (Lifecycle Event)
May 14 03:35:49.998383 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:50.001998 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance spawned successfully.
May 14 03:35:50.002528 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:50.501953 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:50.506278 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:50.510836 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:50.514701 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.518729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.518729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.518729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.518729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.518729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:50.615526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Found WWN 3300000003e998b91 for multipath device dm-9 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:35:50.615756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.064s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:35:50.617672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== connect_volume: return (3066ms) {'type': 'block', 'scsi_wwn': '3300000003e998b91', 'path': '/dev/dm-9', 'multipath_id': '3300000003e998b91'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:35:50.619260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003e998b91', 'path': '/dev/dm-9', 'multipath_id': '3300000003e998b91'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:35:51.025141 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:35:51.025663 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729751.025225, 42a1f2e8-804b-4703-ad8d-4ecf57fe737a => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:51.025663 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] VM Paused (Lifecycle Event)
May 14 03:35:51.029556 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Took 8.73 seconds to spawn the instance on the hypervisor.
May 14 03:35:51.029556 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:51.047422 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:51.050259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.050259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.050509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.050575 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] No waiting events found dispatching network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:51.050775 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-eff844a3-119a-4934-b7b8-d33e313a1bc2 req-e08dd3ab-b137-4826-8393-b1703e63fc50 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received unexpected event network-vif-plugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 for instance with vm_state building and task_state spawning.
May 14 03:35:51.136518 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.136806 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.142031 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.143510 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.143782 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.145523 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.146395 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.146582 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.147880 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.148751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.148926 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.151716 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.156497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.156497 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.156497 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.156497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.156497 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.157194 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.158776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:35:51.159129 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.160556 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.162417 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lazy-loading 'pci_devices' on Instance uuid 49558f8d-c20a-4fce-80c6-7959b0ade9ff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:35:51.248240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.250407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.531490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:51.531490 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729751.5297265, 42a1f2e8-804b-4703-ad8d-4ecf57fe737a => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:51.531490 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] VM Resumed (Lifecycle Event)
May 14 03:35:51.552115 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Took 14.68 seconds to build instance.
May 14 03:35:51.669596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] End _get_guest_xml xml=<domain type="qemu">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <uuid>49558f8d-c20a-4fce-80c6-7959b0ade9ff</uuid>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <name>instance-0000000f</name>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:name>tempest-device-tagging-server-228783713</nova:name>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:35:37</nova:creationTime>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:user uuid="b38d1b2fe1e04b09af7f4ddf5440e24a">tempest-TaggedBootDevicesTest_v242-1762907854-project-member</nova:user>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:project uuid="346418886705456e9de817c5a6473e49">tempest-TaggedBootDevicesTest_v242-1762907854</nova:project>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="ab798e2b-be0a-492d-9b09-98a7b7225055">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="7d31361a-05f8-48b4-86b6-a308841519b6">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="65705ae3-abe6-46c8-8cd9-00e9ff42b480">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="627a44d5-69b7-409d-b04d-d73bde9a4c24">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="d7e11d12-da95-4f0b-8c38-d786307636f6">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="643b4c43-b59a-4d6c-a242-5832a584a375">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         <nova:port uuid="f5053041-b640-4476-bb1b-eaa08f9cc4ef">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <system>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="serial">49558f8d-c20a-4fce-80c6-7959b0ade9ff</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="uuid">49558f8d-c20a-4fce-80c6-7959b0ade9ff</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </system>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <os>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </os>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <features>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </features>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   <devices>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/disk.config"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <alias name="ua-1232e137-9536-4dfe-8d48-86b187100996"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-5"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <serial>1232e137-9536-4dfe-8d48-86b187100996</serial>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <alias name="ua-b0f8f542-acd2-44d3-a5a9-660b891fc660"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-8"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <serial>b0f8f542-acd2-44d3-a5a9-660b891fc660</serial>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <alias name="ua-71342ded-3d4b-4074-8ce7-29512e63abfc"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-9"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="vdc" bus="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <serial>71342ded-3d4b-4074-8ce7-29512e63abfc</serial>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </disk>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5f:d2:a0"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tapab798e2b-be"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b8:85:58"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tap7d31361a-05"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:a1:a3:ed"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tap65705ae3-ab"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:05:b1:f3"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tap627a44d5-69"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:15:20:da"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tapd7e11d12-da"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:52:d1:7e"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tap643b4c43-b5"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:15:ea:a0"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <target dev="tapf5053041-b6"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </interface>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/console.log" append="off"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </serial>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <video>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </video>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </rng>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:   </devices>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]: </domain>
May 14 03:35:51.669596 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Preparing to wait for external event network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:51.682007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:51.682865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.682865 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.685915 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.685915 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.685915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.685915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.686822 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.688909 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.688909 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed74eac3-c694-5718-9f36-66f8097d0b2a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.691559 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.692587 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.698312 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.698618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab798e2b-be, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.699627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab798e2b-be, col_values=(('qos', UUID('da6a57d9-a1e9-45f6-84d1-51bd95a2663a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.699627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab798e2b-be, col_values=(('external_ids', {'iface-id': 'ab798e2b-be0a-492d-9b09-98a7b7225055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:d2:a0', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.700461 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.703040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.711515 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.714164 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be')
May 14 03:35:51.715048 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.715285 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.715981 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.716271 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.716922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.717087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.719704 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.720200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.720425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a1a521-4ced-5b05-883c-a2937cd28a71', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.721925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.723586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.734126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.738848 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.741070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d31361a-05, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.741070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d31361a-05, col_values=(('qos', UUID('6ac0eb80-5ea1-4d45-bf47-11b3f24ebc69')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.741070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d31361a-05, col_values=(('external_ids', {'iface-id': '7d31361a-05f8-48b4-86b6-a308841519b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:85:58', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.744444 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.744444 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.753216 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:35:51.760856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.762075 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05')
May 14 03:35:51.764112 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.764112 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.764583 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.767775 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.767775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.767775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.767775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.769502 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.770806 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9644fc30-5d64-5ea9-96e8-2136019625f5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.772665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.773958 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.787579 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.798985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.798985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65705ae3-ab, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.798985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65705ae3-ab, col_values=(('qos', UUID('5f84a308-8557-4b7e-bbc7-06f9c6a13eb8')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.799248 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65705ae3-ab, col_values=(('external_ids', {'iface-id': '65705ae3-abe6-46c8-8cd9-00e9ff42b480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:a3:ed', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.801839 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.803795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.827936 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.829000 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab')
May 14 03:35:51.829613 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.830779 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.830779 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.830779 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.830947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.831194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.831400 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.832368 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.832560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fecc4cd-b793-5f9f-b9f3-c5f14e9bb288', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.837666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.837666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.859133 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.862654 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.862923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap627a44d5-69, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.863308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap627a44d5-69, col_values=(('qos', UUID('5cc39bb1-e9d5-4b45-a427-ccea09ce862c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.863486 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap627a44d5-69, col_values=(('external_ids', {'iface-id': '627a44d5-69b7-409d-b04d-d73bde9a4c24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:b1:f3', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.866085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.868372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.894328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.895603 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69')
May 14 03:35:51.896391 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.896717 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.897407 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.897516 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.897844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.898072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.898562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.902183 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.902459 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f487aba6-f31a-56e2-b309-ada13020a247', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.904252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.904468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.930355 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.934309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.934309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7e11d12-da, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.934678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7e11d12-da, col_values=(('qos', UUID('deab3f6e-1dd3-4deb-bac3-b1a3aff5a47e')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.934846 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7e11d12-da, col_values=(('external_ids', {'iface-id': 'd7e11d12-da95-4f0b-8c38-d786307636f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:20:da', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.935934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.937459 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:51.969947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.971227 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da')
May 14 03:35:51.972024 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:51.972203 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:51.972827 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:51.973082 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:51.973762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.973762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.973762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:51.974625 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.974765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f1c0702-ed6d-5324-92e5-68e54d89f688', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:51.975608 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:51.977033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:52.017005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.020055 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.020340 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap643b4c43-b5, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.020855 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap643b4c43-b5, col_values=(('qos', UUID('365dedbf-25fd-4128-b7ec-08e586e9ccf0')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.021159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap643b4c43-b5, col_values=(('external_ids', {'iface-id': '643b4c43-b59a-4d6c-a242-5832a584a375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:d1:7e', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.022272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.023887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:52.033175 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:52.037196 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:52.054019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-852fb84f-e1af-475a-84bd-d6d50faf29c4 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.199s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:52.064183 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.066800 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5')
May 14 03:35:52.067468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:35:52.067689 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:35:52.068183 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:35:52.068418 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:35:52.068877 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.069066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.069230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:35:52.070486 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.070631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a83864c4-4b3d-5e2d-8ef6-fa413e32cd83', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.072360 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.072935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:52.105183 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.108459 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.108697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5053041-b6, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.109053 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5053041-b6, col_values=(('qos', UUID('989c5122-06bd-4281-bc52-1649867b188c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.109210 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5053041-b6, col_values=(('external_ids', {'iface-id': 'f5053041-b640-4476-bb1b-eaa08f9cc4ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:ea:a0', 'vm-uuid': '49558f8d-c20a-4fce-80c6-7959b0ade9ff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:35:52.110071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.113459 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:35:52.149346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:52.149924 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6')
May 14 03:35:52.336479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:52.336746 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:52.340809 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:35:52.340952 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Claim successful on node np0000000741
May 14 03:35:53.325833 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:53.680276 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:53.680731 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:35:53.680953 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] No VIF found with MAC fa:16:3e:5f:d2:a0, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:53.681323 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] No VIF found with MAC fa:16:3e:15:20:da, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:35:53.683942 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Using config drive
May 14 03:35:53.809147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:35:53.809605 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:35:54.072930 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:54.194330 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:54.316732 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:35:54.349120 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Creating config drive at /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/disk.config
May 14 03:35:54.354618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp17135p22 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:54.407598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp17135p22" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:54.582369 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] instance snapshotting
May 14 03:35:54.678904 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Beginning live snapshot process
May 14 03:35:54.824319 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.487s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:54.824929 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:35:54.927780 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.004624 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.006395 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.070110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.229774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.268739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.284454 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.286486 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.287774 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8af9ac81-2a3a-43a1-a39b-2b8c9788022c req-24b4ea6d-dad3-4a42-b294-8bb35ce55e60 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:55.288071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8af9ac81-2a3a-43a1-a39b-2b8c9788022c req-24b4ea6d-dad3-4a42-b294-8bb35ce55e60 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:55.288237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8af9ac81-2a3a-43a1-a39b-2b8c9788022c req-24b4ea6d-dad3-4a42-b294-8bb35ce55e60 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:55.288450 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8af9ac81-2a3a-43a1-a39b-2b8c9788022c req-24b4ea6d-dad3-4a42-b294-8bb35ce55e60 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:55.288624 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8af9ac81-2a3a-43a1-a39b-2b8c9788022c req-24b4ea6d-dad3-4a42-b294-8bb35ce55e60 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:55.347844 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:35:55.347844 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:35:55.347844 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:55.347844 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:55.373241 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.400744 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.441671 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.450482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.490967 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.511683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.541659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.584656 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03f07c927d2143d2961164592bd62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3492928cd5f64475bf5572822120dbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:35:55.589563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.654587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c10eaf5-afbb-4afa-b1b4-f167874918b1 req-efd9f162-b489-4326-a0aa-b9eb69afd279 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:55.655670 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c10eaf5-afbb-4afa-b1b4-f167874918b1 req-efd9f162-b489-4326-a0aa-b9eb69afd279 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:55.655670 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c10eaf5-afbb-4afa-b1b4-f167874918b1 req-efd9f162-b489-4326-a0aa-b9eb69afd279 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:55.656839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c10eaf5-afbb-4afa-b1b4-f167874918b1 req-efd9f162-b489-4326-a0aa-b9eb69afd279 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:55.657080 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c10eaf5-afbb-4afa-b1b4-f167874918b1 req-efd9f162-b489-4326-a0aa-b9eb69afd279 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:55.694954 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.783256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.790984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.794402 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.829217 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.848108 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:35:55.867577 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:55.981015 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.130151 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.132852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.135072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.163213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.204993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:56.314600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json -f qcow2" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:56.315837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:56.337839 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-71582170-2fb5-404d-9b90-5323e3dd5196 req-dfcbfdba-f103-47d0-8745-7d99c25cb507 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:56.338921 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-71582170-2fb5-404d-9b90-5323e3dd5196 req-dfcbfdba-f103-47d0-8745-7d99c25cb507 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:56.339354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-71582170-2fb5-404d-9b90-5323e3dd5196 req-dfcbfdba-f103-47d0-8745-7d99c25cb507 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:56.339730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-71582170-2fb5-404d-9b90-5323e3dd5196 req-dfcbfdba-f103-47d0-8745-7d99c25cb507 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:56.340014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-71582170-2fb5-404d-9b90-5323e3dd5196 req-dfcbfdba-f103-47d0-8745-7d99c25cb507 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:56.355276 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:35:56.410531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json -f qcow2" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:56.412845 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:56.420034 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:56.424069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:56.441785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.535428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:56.535888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4.delta 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:56.593517 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4.delta 1073741824" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:56.595259 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 03:35:56.605074 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.806030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:56.838328 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Successfully created port: 1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:35:56.947513 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:35:56.949864 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 03:35:57.001248 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:35:57.002106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4.delta /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.111187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.128715 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4.delta /opt/stack/data/nova/instances/snapshots/tmpovjbuzy5/db4413afadff4ced856596990cebb4d4" returned: 0 in 0.126s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.129736 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Snapshot extracted, beginning image upload
May 14 03:35:57.197744 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.201798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.207732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.208961 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729757.2085037, 49558f8d-c20a-4fce-80c6-7959b0ade9ff => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:57.209105 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] VM Started (Lifecycle Event)
May 14 03:35:57.231270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.369409 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:35:57.370597 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:35:57.370597 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Creating image(s)
May 14 03:35:57.371438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.371438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.371847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.372480 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:57.376207 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:57.378888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.428933 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.430770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.431660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.434580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.436245 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 in dict_keys([('network-vif-plugged', '627a44d5-69b7-409d-b04d-d73bde9a4c24'), ('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6'), ('network-vif-plugged', '643b4c43-b59a-4d6c-a242-5832a584a375'), ('network-vif-plugged', 'f5053041-b640-4476-bb1b-eaa08f9cc4ef')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:57.437156 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-ab798e2b-be0a-492d-9b09-98a7b7225055 for instance with vm_state building and task_state spawning.
May 14 03:35:57.438355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.439396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.440277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.440614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.440701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:57.441971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.441971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.443473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.443745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.443998 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef in dict_keys([('network-vif-plugged', '627a44d5-69b7-409d-b04d-d73bde9a4c24'), ('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6'), ('network-vif-plugged', '643b4c43-b59a-4d6c-a242-5832a584a375')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:57.444196 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b523a595-d00c-42ce-8f95-81a15ced7367 req-26d6f8da-f660-4b1d-9128-19a75209f534 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef for instance with vm_state building and task_state spawning.
May 14 03:35:57.489705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.489705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.489705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:57.490437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.492132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.492132 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:57.496204 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:35:57.496880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.600854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.601519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.620969 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Successfully updated port: 1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:35:57.649373 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk 1073741824" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.650516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.650516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.716999 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:57.724954 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729757.7243934, 49558f8d-c20a-4fce-80c6-7959b0ade9ff => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:57.725604 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] VM Paused (Lifecycle Event)
May 14 03:35:57.742264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.742738 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:35:57.743020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:35:57.773727 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.774217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.774768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.774837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.775229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 in dict_keys([('network-vif-plugged', '627a44d5-69b7-409d-b04d-d73bde9a4c24'), ('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6'), ('network-vif-plugged', '643b4c43-b59a-4d6c-a242-5832a584a375')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:57.775229 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-7d31361a-05f8-48b4-86b6-a308841519b6 for instance with vm_state building and task_state spawning.
May 14 03:35:57.775805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.775805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.775899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.776077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.776209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:57.776425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.776586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.776786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.776917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:57.777089 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 in dict_keys([('network-vif-plugged', '627a44d5-69b7-409d-b04d-d73bde9a4c24'), ('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:57.777248 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-643b4c43-b59a-4d6c-a242-5832a584a375 for instance with vm_state building and task_state spawning.
May 14 03:35:57.777499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-changed-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:57.777575 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Refreshing instance network info cache due to event network-changed-1b3244b2-8c49-400e-a1bf-35efd21b792a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:35:57.777831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Acquiring lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:57.777956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Acquired lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:57.778242 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Refreshing network info cache for port 1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:35:57.849623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:35:57.849623 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Cannot resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:35:57.850019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:35:57.850239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Ensure instance console log exists: /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:35:57.850702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:57.850702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:57.850915 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.125336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:35:58.232673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:58.238368 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:58.285350 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:35:58.330416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:35:58.380557 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:58.425425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 in dict_keys([('network-vif-plugged', '627a44d5-69b7-409d-b04d-d73bde9a4c24'), ('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 for instance with vm_state building and task_state spawning.
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.427765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No event matching network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 in dict_keys([('network-vif-plugged', 'd7e11d12-da95-4f0b-8c38-d786307636f6')]) {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 03:35:58.428796 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 for instance with vm_state building and task_state spawning.
May 14 03:35:58.428973 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.429427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.429427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.429427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.430165 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Processing event network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:35:58.430165 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.430165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.430165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.430165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.430391 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:58.430901 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received unexpected event network-vif-plugged-d7e11d12-da95-4f0b-8c38-d786307636f6 for instance with vm_state building and task_state spawning.
May 14 03:35:58.431222 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:35:58.431222 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:35:58.431733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:35:58.431733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:35:58.431733 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:35:58.431733 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d8d24584-8b44-4768-8575-b86bf30c52d6 req-dfe7213f-7b11-41bd-847f-a6cdb64f68c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state building and task_state spawning.
May 14 03:35:58.433828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:35:58.437736 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:35:58.443441 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance spawned successfully.
May 14 03:35:58.444565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:35:58.572239 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:35:58.743383 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:35:58.743962 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729758.7435408, 49558f8d-c20a-4fce-80c6-7959b0ade9ff => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:35:58.743962 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] VM Resumed (Lifecycle Event)
May 14 03:35:58.972185 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:58.973343 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:58.975222 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:58.976934 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:58.978100 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:58.978959 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:35:59.075566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1377f955-e724-4522-87d8-09df8451ee89 req-f2002c06-e841-4496-9fc3-bd1c7857e743 service nova] Releasing lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:35:59.078452 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquired lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:35:59.078452 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:35:59.249921 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:59.261082 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:35:59.497401 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Took 34.97 seconds to spawn the instance on the hypervisor.
May 14 03:35:59.497401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:35:59.699503 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:35:59.763854 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:36:00.005158 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:00.025749 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Took 48.27 seconds to build instance.
May 14 03:36:00.236419 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:00.334232 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Snapshot image upload complete
May 14 03:36:00.334438 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cfb67f1f-aeb7-4ead-98b2-db987110ef96 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Took 5.75 seconds to snapshot the instance on the hypervisor.
May 14 03:36:00.532876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f70e384-e807-4f36-897e-2d8c33f57148 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.785s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:00.556773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:00.556773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:00.559513 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:00.739300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Releasing lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:00.740842 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance network_info: |[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:36:00.743357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start _get_guest_xml network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:00.747117 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:00.748165 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1243629956', uuid='7d8e14e9-c419-444d-9a38-73b5f8f65cba'), owner=OwnerMeta(userid='03f07c927d2143d2961164592bd62449', username='tempest-AttachVolumeTestJSON-1091031368-project-member', projectid='3492928cd5f64475bf5572822120dbbc', projectname='tempest-AttachVolumeTestJSON-1091031368'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729760.7477982) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:00.749168 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:00.749553 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:00.750441 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:00.750710 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:00.751465 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:00.751800 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:00.751929 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:00.752017 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:00.752131 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:00.752206 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:00.752289 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:00.752425 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:00.752555 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:00.752618 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:00.752737 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:00.752846 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:00.775670 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:00.775670 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:00.776463 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:00.777236 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:01.064168 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:01.261589 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'pci_requests' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:01.280922 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <uuid>7d8e14e9-c419-444d-9a38-73b5f8f65cba</uuid>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <name>instance-00000011</name>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeTestJSON-server-1243629956</nova:name>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:00</nova:creationTime>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:user uuid="03f07c927d2143d2961164592bd62449">tempest-AttachVolumeTestJSON-1091031368-project-member</nova:user>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:project uuid="3492928cd5f64475bf5572822120dbbc">tempest-AttachVolumeTestJSON-1091031368</nova:project>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         <nova:port uuid="1b3244b2-8c49-400e-a1bf-35efd21b792a">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="serial">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="uuid">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0a:fd:77"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <target dev="tap1b3244b2-8c"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/console.log" append="off"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:01.280922 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Preparing to wait for external event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:01.285739 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:01.286389 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:01.286786 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:01.287166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.287447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:01.287803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:01.289180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.289180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2464d8f-4f72-5b72-8b00-327620658182', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:01.299678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.300703 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:01.301065 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.307778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.307778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3244b2-8c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:01.309090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b3244b2-8c, col_values=(('qos', UUID('acf3549a-c584-463f-9f72-f6703edaab5e')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:01.309090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b3244b2-8c, col_values=(('external_ids', {'iface-id': '1b3244b2-8c49-400e-a1bf-35efd21b792a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fd:77', 'vm-uuid': '7d8e14e9-c419-444d-9a38-73b5f8f65cba'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:01.313284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.314565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:01.319716 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:01.320751 np0000000741 nova-compute[97948]: INFO os_vif [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:36:01.767877 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Object Instance<8dbcc9c2-0ce8-4450-9772-a532b41e53f7> lazy-loaded attributes: flavor,pci_requests {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:01.767877 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:36:01.768345 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:01.768345 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:01.935145 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82973e4b28774576bcce6851483a08f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf8c09511e44fecb39453337950bdf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:36:02.181865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-changed-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:02.181945 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing instance network info cache due to event network-changed-ab798e2b-be0a-492d-9b09-98a7b7225055. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:02.184977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] Acquiring lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:02.184977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] Acquired lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:02.184977 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Refreshing network info cache for port ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:02.596704 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:02.596985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:02.627722 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Successfully created port: 2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:36:02.689294 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:02.854209 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:02.854836 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:02.854992 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:0a:fd:77, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:02.855909 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Using config drive
May 14 03:36:03.101135 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:36:03.132968 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:03.297555 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Successfully updated port: 2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:36:03.310227 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updated VIF entry in instance network info cache for port ab798e2b-be0a-492d-9b09-98a7b7225055. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:36:03.311292 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:03.330563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:03.363376 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:03.384355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-changed-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:03.384552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing instance network info cache due to event network-changed-2434e4b3-4be5-4964-9534-519ad86fcacb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:03.384875 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:03.384995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:03.385079 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Refreshing network info cache for port 2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:03.513764 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Creating config drive at /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config
May 14 03:36:03.519901 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpidk9gi3m {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:03.563151 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpidk9gi3m" returned: 0 in 0.043s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:03.654419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:03.654679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:03.660224 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:36:03.660339 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Claim successful on node np0000000741
May 14 03:36:03.804833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:03.816082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae26a13e-5d53-4619-b890-cfcf12d49e4e req-310fdded-e589-4747-a4a3-e4a520c39bdf service nova] Releasing lock "refresh_cache-49558f8d-c20a-4fce-80c6-7959b0ade9ff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:03.887621 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:04.025252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.053372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.055666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.143031 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.350161 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:04.389928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.392118 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.398692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.421739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.424779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:04.540100 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Added VIF to instance network info cache for port 2434e4b3-4be5-4964-9534-519ad86fcacb. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3528}}
May 14 03:36:04.540420 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:05.030749 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729765.03026, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:05.031075 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Started (Lifecycle Event)
May 14 03:36:05.043102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-294b2595-53d5-4183-9a21-fc8c9b4a042b req-bcc8e3ce-e7da-4028-8ac1-a2e058c93be1 service nova] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:05.046537 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:05.046537 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:05.158653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:05.158653 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:05.388508 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:05.388982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:05.534096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:05.537550 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729765.537302, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:05.538348 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Paused (Lifecycle Event)
May 14 03:36:05.557834 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:05.562081 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:05.562508 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:05.562592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:05.562829 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Processing event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:36:05.562966 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:05.563147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:05.563318 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:05.564983 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:36:05.565217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:05.565401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:05.565592 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-59d3d763-3b5c-4916-9c22-bd6bfe98e34a req-d8badd38-892c-4693-bcef-c69497d093c6 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state building and task_state spawning.
May 14 03:36:05.567903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:36:05.569679 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance spawned successfully.
May 14 03:36:05.570926 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:36:05.592783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:05.592944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:05.637775 np0000000741 nova-compute[97948]: WARNING nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] 3d875d0a-bed8-4c8a-9609-adc7526c96a8 already exists in list: networks containing: ['3d875d0a-bed8-4c8a-9609-adc7526c96a8']. ignoring it
May 14 03:36:05.637925 np0000000741 nova-compute[97948]: WARNING nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] 2434e4b3-4be5-4964-9534-519ad86fcacb already exists in list: port_ids containing: ['2434e4b3-4be5-4964-9534-519ad86fcacb']. ignoring it
May 14 03:36:05.661141 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:05.877833 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:05.896330 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:06.040925 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:06.044453 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729766.044044, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:06.044714 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Resumed (Lifecycle Event)
May 14 03:36:06.084099 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.084254 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.084647 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.084923 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.085240 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.085571 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:06.095789 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Detaching volume fdcd6a6a-129a-49fe-bdfc-8790ca150fc0
May 14 03:36:06.170606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.516s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:06.171094 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:36:06.176425 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Attempting to driver detach volume fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 from mountpoint /dev/vdb
May 14 03:36:06.181824 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found disk vdb by alias ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:06.183602 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found disk vdb by alias ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:06.183602 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Attempting to detach device vdb from instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:36:06.183881 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <alias name="ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0"/>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <serial>fdcd6a6a-129a-49fe-bdfc-8790ca150fc0</serial>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:06.183881 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:06.192812 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully detached device vdb from instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 from the persistent domain config.
May 14 03:36:06.192960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] (1/8): Attempting to detach device vdb with device alias ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 from instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:36:06.193221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <alias name="ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0"/>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <serial>fdcd6a6a-129a-49fe-bdfc-8790ca150fc0</serial>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:06.193221 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:06.281264 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:06.315990 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.445497 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:06.521603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:06.521791 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:06.521927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:06.522699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:06.522864 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:06.525194 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Terminating instance
May 14 03:36:06.548348 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:06.550390 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:06.591449 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Took 9.22 seconds to spawn the instance on the hypervisor.
May 14 03:36:06.591614 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:06.678506 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:36:06.678852 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:36:06.679167 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:06.679975 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:06.752327 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe2ffc6cce044f7ad75df57827bc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6177683ef84349e5a26042f334b26ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:36:06.900299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:06.912927 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 for instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:36:06.947585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:06.950554 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:06.950786 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:06.951838 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:06.951937 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:06.955677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.955677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:06.955677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:06.956655 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.957491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea932787-4b85-5926-8532-9f91d478b647', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:06.957694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.958416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:06.961792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.965407 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.967427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2434e4b3-4b, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:06.967427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2434e4b3-4b, col_values=(('qos', UUID('d587a658-9d71-4f22-a667-3569daf0083a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:06.967427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2434e4b3-4b, col_values=(('external_ids', {'iface-id': '2434e4b3-4be5-4964-9534-519ad86fcacb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:e6:96', 'vm-uuid': '8dbcc9c2-0ce8-4450-9772-a532b41e53f7'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:06.967427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.968091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:06.974496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:06.975850 np0000000741 nova-compute[97948]: INFO os_vif [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b')
May 14 03:36:06.977784 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:06.977784 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:06.977784 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:06.979176 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] attach device xml: <interface type="ethernet">
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:   <mac address="fa:16:3e:4c:e6:96"/>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:   <model type="virtio"/>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:   <driver name="qemu"/>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:   <mtu size="1372"/>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:   <target dev="tap2434e4b3-4b"/>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]: </interface>
May 14 03:36:06.979176 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:36:06.995497 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.028938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:36:07.057793 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:36:07.059148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729767.0586965, 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 => ua-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:36:07.065838 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully detached device vdb from instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 from the live domain config.
May 14 03:36:07.067240 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:07.067916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:07.067916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:07.068321 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:07.068738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:07.068936 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:07.083276 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.087561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.104311 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.107051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.110939 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Took 14.85 seconds to build instance.
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.122156 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.122583 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:07.122583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', '28')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:07.125190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', '27')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:07.125190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c4220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:07.127393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:07.127911 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flush multipath device 330000000fb01bcf3 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:07.141321 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.153759 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.182058 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:36:07.260955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:07.312741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:07.362473 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:07.362473 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:07.363895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:07.382696 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99965344300017 future=<Future at 0x79d0b01b2660 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:07.383259 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998861257000044 future=<Future at 0x79d0b01b2660 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:07.383402 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.9986630530002 future=<Future at 0x79d0b01b2660 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:07.385805 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Instance destroyed successfully.
May 14 03:36:07.386969 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lazy-loading 'resources' on Instance uuid 7ff50ead-8117-44fd-9be6-8ac88fa1f76d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:07.394971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:07.395216 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:07.415590 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.420495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.426382 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.449347 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Successfully created port: 4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:36:07.461164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.478602 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.40.100,3260]
May 14 03:36:07.478602 np0000000741 nova-compute[97948]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.40.100,3260] successful.
May 14 03:36:07.478602 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.498293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.512107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.566827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.50.100,3260]
May 14 03:36:07.566827 np0000000741 nova-compute[97948]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, portal: 192.168.50.100,3260] successful.
May 14 03:36:07.566827 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.597515 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:07.597917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.529s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:07.598749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== disconnect_volume: return (530ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:07.598749 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:07.614563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f85b126c-aba9-47d4-816c-c47dc3ed94bd tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.366s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:07.618770 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.643801 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.652109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.685853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:36:07.890286 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1500104163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionsv293testjson-server-1695037310',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc9wq6ZcqZBqBcEQckSVfkLeVLw1PJjg+qL+SUvZ1ZJiOUqKaIMBvrmwOPZLKOfm082BBTKFMdDnyzu8VU3JeYXippJdKLfg9orhXVY3TNjX/Sxck5kNTEjYrGZVk/1sA==',key_name='tempest-keypair-912801489',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:26Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c875214b84942f4b242e6a4213ba7ff',ramdisk_id='',reservation_id='r-ci0mbzdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1469734157',owner_user_name='tempest-ServerActionsV293TestJSON-1469734157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2014044c024e0891b86095ab736fc1',uuid=7ff50ead-8117-44fd-9be6-8ac88fa1f76d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:07.890718 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converting VIF {"id": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "address": "fa:16:3e:b5:d8:92", "network": {"id": "98cfd9e1-00a6-4e92-bae1-5244883fbb9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283610713-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c875214b84942f4b242e6a4213ba7ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ebf74d-74", "ovs_interfaceid": "85ebf74d-7491-40f6-8d0b-502c1e3b6e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:07.891622 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:07.891735 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:07.894346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.894346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ebf74d-74, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:07.896819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.896819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:07.897479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.897732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f5e6b3e-d75c-4236-b0a2-e4ad280cc59c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:07.899038 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.899038 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:07.901586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:07.904219 np0000000741 nova-compute[97948]: INFO os_vif [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d8:92,bridge_name='br-int',has_traffic_filtering=True,id=85ebf74d-7491-40f6-8d0b-502c1e3b6e7d,network=Network(98cfd9e1-00a6-4e92-bae1-5244883fbb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ebf74d-74')
May 14 03:36:07.905664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:07.905984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:07.906762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:07.906762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:07.907009 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f4fe53-19a1-4009-b32b-4dc114f19b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:07.908372 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:07.924121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:07.924347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:07.925075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:07.925075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:07.925075 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:07.925075 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f68c8ae8-9349-4c3f-8b9f-5de9178da5fe req-82a660cc-9769-47db-ac80-d3fe7984105d service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:07.950676 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:07.951785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:07.951785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '25')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:07.956441 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:07.956692 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:07.956984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:07.957124 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:07.957274 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:07.957406 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b9c3524d-94fb-4527-92b8-f0c255eb3089 req-489d005b-d54a-40ea-b283-0968058293da service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb for instance with vm_state active and task_state None.
May 14 03:36:07.960302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52', '26')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:07.960601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0223240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:07.960892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:07.961168 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Flush multipath device 3300000004fd344d4 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:08.016821 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:08.058458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:08.066536 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:08.066758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:08.066995 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attaching volume 8a58d328-9987-4d02-9cd8-6203a8f70d61 to /dev/vdb
May 14 03:36:08.106591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:08.106702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:08.108039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:08.129888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:08.129888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:08.150027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.150794 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:08.170222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:08.192545 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Booting with blank volume at /dev/vda
May 14 03:36:08.196316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260]
May 14 03:36:08.196316 np0000000741 nova-compute[97948]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.40.100,3260] successful.
May 14 03:36:08.196316 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.199701 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:08.208536 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:08.230621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.245050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.250659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:08.250915 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:08.262507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:08.265705 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe61:6207', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe5f:d2a0', 'fe80::90da:47ff:fe9b:cd76', 'fe80::fc16:3eff:feb8:8558', 'fe80::fc16:3eff:fea1:a3ed', 'fe80::fc16:3eff:fe05:b1f3', 'fe80::fc16:3eff:fe15:20da', 'fe80::fc16:3eff:fe52:d17e', 'fe80::9c8e:a1ff:fe39:fba6', 'fe80::fc16:3eff:fe15:eaa0', 'fe80::10d3:9fff:fe74:6bfd', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe4c:e696', 'fe80::c8c2:43ff:fe36:59'] 
May 14 03:36:08.265906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:08.266129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:08.266510 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:08.271339 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating existing volume attachment record: aa183ff5-fa4e-4e5c-a399-da6cb5a153c0 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:08.285060 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Successfully updated port: 4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:36:08.290187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260]
May 14 03:36:08.290187 np0000000741 nova-compute[97948]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-f4f4fe53-19a1-4009-b32b-4dc114f19b52, portal: 192.168.50.100,3260] successful.
May 14 03:36:08.290187 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.320078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.320078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:08.320078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] <== disconnect_volume: return (411ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:08.320078 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:08.322392 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deleting instance files /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d_del
May 14 03:36:08.322392 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deletion of /opt/stack/data/nova/instances/7ff50ead-8117-44fd-9be6-8ac88fa1f76d_del complete
May 14 03:36:08.337551 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:08.607705 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-changed-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:08.608372 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Refreshing instance network info cache due to event network-changed-4152108d-8740-489b-ae2f-66c9ab88a526. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:08.608606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] Acquiring lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:08.608725 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] Acquired lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:08.608841 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Refreshing network info cache for port 4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:08.662189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:08.662337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:08.662452 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No VIF found with MAC fa:16:3e:8e:f1:03, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:08.800719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:08.835701 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Took 1.80 seconds to destroy the instance on the hypervisor.
May 14 03:36:08.835701 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:36:08.835701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:36:08.835701 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:36:08.835701 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:08.881457 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:08.881577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:08.881693 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:08.885269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:08.885491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:08.901972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:08.901972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:08.901972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:08.901972 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:08.902239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:08.902383 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:08.914917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:08.914917 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.923663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:08.923663 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.927712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61] added
May 14 03:36:08.927712 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:08.927712 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:08.927712 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:08.927712 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:08.927712 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:08.927712 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.927986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:08.928232 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:08.928446 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:08.930861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61] added
May 14 03:36:08.930861 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:08.930861 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:08.930861 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:08.930861 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:08.930861 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:08.930861 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:08.931064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:08.931308 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:08.931545 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:08.956665 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:09.111239 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:09.143608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:09.168230 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-105715718', uuid='8dbcc9c2-0ce8-4450-9772-a532b41e53f7'), owner=OwnerMeta(userid='82973e4b28774576bcce6851483a08f9', username='tempest-TaggedAttachmentsTest-1383375675-project-member', projectid='0bf8c09511e44fecb39453337950bdf2', projectname='tempest-TaggedAttachmentsTest-1383375675'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729769.1675057) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:09.169224 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:09</nova:creationTime>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     <nova:port uuid="2434e4b3-4be5-4964-9534-519ad86fcacb">
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:09.169224 np0000000741 nova-compute[97948]:  {{(pid=97948) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 03:36:09.211738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-92910d44-0944-4fbe-b764-d4e7e43049bc tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.619s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:09.213413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.070s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:09.214308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:09.214584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:09.215191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:09.219685 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Terminating instance
May 14 03:36:09.259293 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:09.484917 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:09.681178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6d6d7a2e-ebc8-477a-89df-32f3572e78d7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 9.124s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:09.711434 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.726478 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:36:09.751666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.757183 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.777184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.787257 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.813954 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.818251 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:09.928998 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:09.934489 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:09.937963 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:09.949063 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:09.949063 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:09.964062 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:09.964062 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:09.973104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:09.982579 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:09.987226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e91f335a-a9fb-440b-8f95-3e751b5afeae req-b4437698-1f11-4c40-90a7-57e82426b207 service nova] Releasing lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:09.988698 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:09.989086 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:09.998149 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:09.999208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.008960 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.009255 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:10.050659 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:10.050659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:10.050659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:10.050845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:10.050929 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:10.051066 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-96532e67-2d77-4d17-9bd4-1137b3a093be req-abaf3c40-5a96-4313-a315-9ff21fa7ec3b service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-plugged-2434e4b3-4be5-4964-9534-519ad86fcacb for instance with vm_state active and task_state None.
May 14 03:36:10.057908 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.50.100,3260]
May 14 03:36:10.057908 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.50.100,3260] successful.
May 14 03:36:10.057908 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:10.059863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.40.100,3260]
May 14 03:36:10.059863 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.40.100,3260] successful.
May 14 03:36:10.059863 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:10.076663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:10.090931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:10.096212 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:10.098795 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Acquiring lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:10.099569 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:10.099845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:10.100009 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] No waiting events found dispatching network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:10.100741 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99873925299994 future=<Future at 0x79d0b841cd70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:10.101577 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-unplugged-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:10.101754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-changed-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:10.101877 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Refreshing instance network info cache due to event network-changed-1b3244b2-8c49-400e-a1bf-35efd21b792a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:10.102653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Acquiring lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:10.102653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Acquired lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:10.102653 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Refreshing network info cache for port 1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.102806 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.103023 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:10.103235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:10.103345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:10.104185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('7', '-', '-', 0) found on session 40 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:10.104937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:10.106589 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Instance destroyed successfully.
May 14 03:36:10.107972 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'resources' on Instance uuid 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:10.123621 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:10.128329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:10.128329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:10.128329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 40 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:10.128329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:10.128329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('8', '-', '-', 0) found on session 41 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:10.129045 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:10.149664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 41 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:10.149664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:10.441953 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Took 1.61 seconds to deallocate network for instance.
May 14 03:36:10.556045 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:10.607001 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:10.611164 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1823611732',display_name='tempest-VolumesBackupsTest-instance-1823611732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1823611732',id=10,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJA/lcMeaBxcnML1vyVJL+uN0tv2j4RgVyW0Pz7fN5T0oDdSSlif2e2iDNSgRA1nF2e2vY4EACGYdxdtKwRN963zVyb9U0BwgoLAE7RR4mKYnUro2r4YuBKtiQHhb60g==',key_name='tempest-keypair-1513035425',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:34:46Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-gdn4xl5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:10.611699 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "address": "fa:16:3e:61:62:07", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e8e58-31", "ovs_interfaceid": "5a2e8e58-3168-4ec8-99e9-93b0b64aaf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:10.612291 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:10.612456 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:10.613818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:10.614319 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a2e8e58-31, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:10.620190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:10.620905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:10.621253 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0eda8b2-4bd4-4a83-9812-09aeeed6dcbb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:10.627776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:10.631969 np0000000741 nova-compute[97948]: INFO os_vif [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:62:07,bridge_name='br-int',has_traffic_filtering=True,id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e8e58-31')
May 14 03:36:10.635663 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:10.635663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:10.635663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:10.776287 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:10.867214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:10.867358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:10.902033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:36:10.983370 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating instance_info_cache with network_info: [{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:11.012730 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:11.016618 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Took 0.57 seconds to detach 1 volumes for instance.
May 14 03:36:11.019192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Deleting volume: f4f4fe53-19a1-4009-b32b-4dc114f19b52 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:36:11.201372 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updated VIF entry in instance network info cache for port 1b3244b2-8c49-400e-a1bf-35efd21b792a. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:36:11.201711 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:11.376490 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:11.487371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:11.487680 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance network_info: |[{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:36:11.579142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:11.579373 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:11.695040 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:11.705673 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:11.706354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Releasing lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:11.706593 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Received event network-vif-deleted-85ebf74d-7491-40f6-8d0b-502c1e3b6e7d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:11.707365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:11.707624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:11.707892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:11.708074 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:11.708245 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] No waiting events found dispatching network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:11.708438 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b018adb5-fa6c-4ce5-9bb6-b251496f01cc req-4cb8f552-2eea-4ff7-b8d3-c3568e158973 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:11.725090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:11.757676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:11.757995 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:11.767234 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:11.768967 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe5f:d2a0', 'fe80::90da:47ff:fe9b:cd76', 'fe80::fc16:3eff:feb8:8558', 'fe80::fc16:3eff:fea1:a3ed', 'fe80::fc16:3eff:fe05:b1f3', 'fe80::fc16:3eff:fe15:20da', 'fe80::fc16:3eff:fe52:d17e', 'fe80::9c8e:a1ff:fe39:fba6', 'fe80::fc16:3eff:fe15:eaa0', 'fe80::10d3:9fff:fe74:6bfd', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe4c:e696', 'fe80::c8c2:43ff:fe36:59'] 
May 14 03:36:11.769136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:11.769292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:11.769570 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:11.773013 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating existing volume attachment record: 0b83a7df-825e-4fc1-8d21-fee554d17727 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:11.920093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found WWN 3300000001120ecfc for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:11.920495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:11.920650 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000001120ecfc', 'path': '/dev/dm-0', 'multipath_id': '3300000001120ecfc'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:11.920785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001120ecfc', 'path': '/dev/dm-0', 'multipath_id': '3300000001120ecfc'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:11.921601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.286s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:11.922146 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:11.924720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:11.926615 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:11.955681 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:11.956039 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:11.956232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '41')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:11.956395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:11.956438 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:36:11.956787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:11.956787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdcd6a6a-129a-49fe-bdfc-8790ca150fc0') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:36:11.956787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0230900>, {}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:11.956867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Disconnecting from: [] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:11.957006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:11.957102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== disconnect_volume: return (1322ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:11.957205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:11.960029 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Deleting instance files /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6_del
May 14 03:36:11.960029 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Deletion of /opt/stack/data/nova/instances/0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6_del complete
May 14 03:36:12.120446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:12.120783 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:12.167020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:12.167259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] Acquiring lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:12.167468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:12.167605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:12.167771 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] No waiting events found dispatching network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:12.168319 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-029d8737-57c7-4c61-a8c8-383911070b08 req-b59815d2-32f9-43d2-a1c4-524f3fa3a380 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-unplugged-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:12.384425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:12.430733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to attach volume 8a58d328-9987-4d02-9cd8-6203a8f70d61 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:36:12.432721 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:   <alias name="ua-8a58d328-9987-4d02-9cd8-6203a8f70d61"/>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:   <serial>8a58d328-9987-4d02-9cd8-6203a8f70d61</serial>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:12.432721 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:36:12.465003 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Took 2.74 seconds to destroy the instance on the hypervisor.
May 14 03:36:12.465822 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:36:12.466186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:36:12.466446 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:36:12.466825 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:12.599158 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:12.623760 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:13.118654 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d6648096-e5b5-4ec2-bea9-5c1fabb8d1d4 req-35b05ab1-364d-4e93-917c-bd7b5a45f5a1 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Received event network-vif-deleted-5a2e8e58-3168-4ec8-99e9-93b0b64aaf56 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:13.119033 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-d6648096-e5b5-4ec2-bea9-5c1fabb8d1d4 req-35b05ab1-364d-4e93-917c-bd7b5a45f5a1 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Neutron deleted interface 5a2e8e58-3168-4ec8-99e9-93b0b64aaf56; detaching it from the instance and deleting it from the info cache
May 14 03:36:13.119196 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d6648096-e5b5-4ec2-bea9-5c1fabb8d1d4 req-35b05ab1-364d-4e93-917c-bd7b5a45f5a1 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:13.133086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.554s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:13.207433 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Deleted allocations for instance 7ff50ead-8117-44fd-9be6-8ac88fa1f76d
May 14 03:36:13.342795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:13.481177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:13.481177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:13.481177 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Attaching volume d7161cfe-ddf4-4d20-aef2-720026ab2b64 to /dev/vdb
May 14 03:36:13.518194 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:13.528881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:13.547079 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:13.551660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:13.600517 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:13.606666 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:13.616661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:13.617173 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe5f:d2a0', 'fe80::90da:47ff:fe9b:cd76', 'fe80::fc16:3eff:feb8:8558', 'fe80::fc16:3eff:fea1:a3ed', 'fe80::fc16:3eff:fe05:b1f3', 'fe80::fc16:3eff:fe15:20da', 'fe80::fc16:3eff:fe52:d17e', 'fe80::9c8e:a1ff:fe39:fba6', 'fe80::fc16:3eff:fe15:eaa0', 'fe80::10d3:9fff:fe74:6bfd', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe4c:e696', 'fe80::c8c2:43ff:fe36:59'] 
May 14 03:36:13.617486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:13.617708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:13.618086 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:13.618451 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating existing volume attachment record: c76b5652-9104-4df8-bd22-13f59d4ba643 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:13.623747 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d6648096-e5b5-4ec2-bea9-5c1fabb8d1d4 req-35b05ab1-364d-4e93-917c-bd7b5a45f5a1 service nova] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Detach interface failed, port_id=5a2e8e58-3168-4ec8-99e9-93b0b64aaf56, reason: Instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:36:13.870496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:13.887494 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:36:13.889205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:36:13.889503 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Creating image(s)
May 14 03:36:13.889904 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:36:13.890083 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Ensure instance console log exists: /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:36:13.890402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:13.891445 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:13.891620 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:13.892799 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start _get_guest_xml network_info=[{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f06ca3e4-a0f1-48d5-99a3-16d877adef99', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'serial': 'b7cf99b4-5a00-4acb-9757-5827b95dd477'}, 'boot_index': 0, 'attachment_id': '0b83a7df-825e-4fc1-8d21-fee554d17727', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:13.895980 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:13.897560 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012', uuid='f06ca3e4-a0f1-48d5-99a3-16d877adef99'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729773.8970826) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:13.899544 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:13.899933 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:13.901162 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:13.901558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:13.903624 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:13.904107 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:13.904484 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:13.904657 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:13.905078 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:13.905331 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:13.905489 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:13.905830 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:13.906046 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:13.906236 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:13.906342 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:13.907001 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:13.925782 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:13.926220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:13.926427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:13.926899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:13.927342 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:13.939904 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:13.940348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:13.940520 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:13.941310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:13.942019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:13.942959 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:13.954652 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:13.954652 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:13.964253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:13.964253 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477] added
May 14 03:36:13.971813 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:13.971813 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:13.971813 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:13.977791 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477] added
May 14 03:36:13.977791 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:13.977791 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:13.977791 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:13.977791 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:13.977791 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:13.977791 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:13.978138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:13.978181 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:13.979487 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:14.071677 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Took 1.61 seconds to deallocate network for instance.
May 14 03:36:14.093573 np0000000741 nova-compute[97948]: WARNING nova.volume.cinder [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Attachment b9c021fc-8322-4ba6-9d1f-430d07c7e292 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b9c021fc-8322-4ba6-9d1f-430d07c7e292. (HTTP 404) (Request-ID: req-7813e8e6-819f-4183-9c43-41326a5f93de)
May 14 03:36:14.093881 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Took 0.02 seconds to detach 1 volumes for instance.
May 14 03:36:14.104594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:14.104806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:14.104977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:14.105152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No VIF found with MAC fa:16:3e:06:b4:3a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:14.182768 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:14.182768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:14.182768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:14.220219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-affc6252-c32d-4f1a-86fb-419c181b6fe9 tempest-ServerActionsV293TestJSON-1469734157 tempest-ServerActionsV293TestJSON-1469734157-project-member] Lock "7ff50ead-8117-44fd-9be6-8ac88fa1f76d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.698s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:14.600115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:14.600983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:14.780031 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:14.782736 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:36:14.974399 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:14.978897 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:14.992025 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:14.992025 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:14.995364 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:14.995364 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.009840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.015331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.027132 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.027476 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:15.033462 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:15.033774 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.038082 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.038356 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:15.084592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.40.100,3260]
May 14 03:36:15.084592 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.40.100,3260] successful.
May 14 03:36:15.084592 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.098432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.50.100,3260]
May 14 03:36:15.098432 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.50.100,3260] successful.
May 14 03:36:15.098432 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.103285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.112043 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.125907 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.126544 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:15.127206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:15.127403 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:15.128777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('9', '-', '-', 0) found on session 42 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:15.128962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.142585 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:15.142918 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:15.143203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:15.143203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:15.144188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('10', '-', '-', 0) found on session 43 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:15.144302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:15.156813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 42 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:15.156813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:15.166032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:15.536893 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:15.624309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:15.685988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f1b140f3-6059-4ac6-80c4-af1393ed7789 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.619s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:15.783391 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:16.047413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.446s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:16.118256 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Deleted allocations for instance 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6
May 14 03:36:16.166605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:16.166796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:16.287850 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:16.288045 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:16.288190 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:16.288407 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:36:16.609991 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:16.744188 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:16.962581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Found WWN 3300000008cf33e27 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:16.962914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:16.963102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000008cf33e27', 'path': '/dev/dm-1', 'multipath_id': '3300000008cf33e27'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:16.963330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008cf33e27', 'path': '/dev/dm-1', 'multipath_id': '3300000008cf33e27'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:16.963967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.781s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:16.967154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:16.977393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:16.977997 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:16.978905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:16.979128 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:16.979572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:16.979795 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:16.991072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:16.991072 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:16.995710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:16.995710 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:17.005170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64] added
May 14 03:36:17.005170 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:17.005170 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:17.005170 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:17.005170 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:17.005170 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:17.005170 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:17.005501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:17.005794 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:17.005794 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64] added
May 14 03:36:17.011051 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:17.011051 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:17.011051 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:17.133655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4acd9cc0-2624-4135-b67b-c93f7e60681a tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.920s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:17.329343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.451294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.452005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.477616 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-2101756012',id=18,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-hv6r7xmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:08Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=f06ca3e4-a0f1-48d5-99a3-16d877adef99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:17.478107 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:17.480073 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:17.481716 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:17.546763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.555140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.669250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.669250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.748015 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.752368 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.850282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.850814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.957917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:17.958994 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:36:17.964584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:17.992732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <uuid>f06ca3e4-a0f1-48d5-99a3-16d877adef99</uuid>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <name>instance-00000012</name>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2101756012</nova:name>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:13</nova:creationTime>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         <nova:port uuid="4152108d-8740-489b-ae2f-66c9ab88a526">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="serial">f06ca3e4-a0f1-48d5-99a3-16d877adef99</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="uuid">f06ca3e4-a0f1-48d5-99a3-16d877adef99</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <alias name="ua-b7cf99b4-5a00-4acb-9757-5827b95dd477"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <serial>b7cf99b4-5a00-4acb-9757-5827b95dd477</serial>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:24:34:56"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <target dev="tap4152108d-87"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/console.log" append="off"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:17.992732 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:17.995871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Preparing to wait for external event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:36:17.995871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:17.995871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:17.995871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:17.998932 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-2101756012',id=18,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-hv6r7xmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:08Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=f06ca3e4-a0f1-48d5-99a3-16d877adef99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:17.999277 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:18.000328 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:18.000762 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:18.001626 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.002369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:18.003324 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:18.005240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.005602 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '093b3a1f-2fc8-5b9b-9d14-a181b1ad8293', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:18.006886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.008229 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:18.011241 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:18.011450 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:18.013794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.013999 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4152108d-87, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:18.014600 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4152108d-87, col_values=(('qos', UUID('b923699e-99cb-467d-a879-478ff8f2f9dc')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:18.014878 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4152108d-87, col_values=(('external_ids', {'iface-id': '4152108d-8740-489b-ae2f-66c9ab88a526', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:34:56', 'vm-uuid': 'f06ca3e4-a0f1-48d5-99a3-16d877adef99'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:18.016033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.018300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:18.024335 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:18.024335 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.026824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.026998 np0000000741 nova-compute[97948]: INFO os_vif [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87')
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:18.031942 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:18.031942 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.043888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.053728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.063458 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.063959 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:18.069266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:18.069813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.092860 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.093306 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:18.126524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.40.100,3260]
May 14 03:36:18.126524 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.40.100,3260] successful.
May 14 03:36:18.126524 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.141538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.153093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.50.100,3260]
May 14 03:36:18.153093 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.50.100,3260] successful.
May 14 03:36:18.153093 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.161930 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.162302 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:18.162694 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:18.162831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:18.163891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] HCTL ('11', '-', '-', 0) found on session 44 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:18.164011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:18.173014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:18.186365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:18.187367 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Searching for a device in session 44 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:18.187698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:18.191161 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:36:18.191395 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:36:18.191524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:36:18.195787 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:18.196866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:18.210097 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:18.211095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:18.211349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:18.215735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] HCTL ('12', '-', '-', 0) found on session 45 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:18.215890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:18.238431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:18.240490 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12892MB free_disk=73.5452651977539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:36:18.240490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:18.240490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:18.243056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Searching for a device in session 45 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:18.243276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:18.343082 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:18.979280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:36:19.339846 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340028 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3defa392-75f0-4f24-b15d-d14ec40200cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340078 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340208 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 42a1f2e8-804b-4703-ad8d-4ecf57fe737a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340316 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340420 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f06ca3e4-a0f1-48d5-99a3-16d877adef99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:36:19.340653 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:36:19.340806 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:36:18 up 28 min,  2 users,  load average: 9.34, 5.67, 2.70\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_0bf8c09511e44fecb39453337950bdf2': '1', 'io_workload': '1', 'num_proj_817445e1e7da4d278a96c6cdd6c14c0e': '1', 'num_proj_346418886705456e9de817c5a6473e49': '1', 'num_proj_6177683ef84349e5a26042f334b26ddd': '2', 'num_proj_3492928cd5f64475bf5572822120dbbc': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:36:19.555171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:19.555171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:19.555171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:24:34:56, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:19.555171 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Using config drive
May 14 03:36:19.768237 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:19.768477 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:20.016026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Found WWN 330000000cd2ce704 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:20.016525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:20.016704 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] <== connect_volume: return (5833ms) {'type': 'block', 'scsi_wwn': '330000000cd2ce704', 'path': '/dev/dm-2', 'multipath_id': '330000000cd2ce704'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:20.016939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd2ce704', 'path': '/dev/dm-2', 'multipath_id': '330000000cd2ce704'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:20.023229 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:20.061329 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:20.214519 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Creating config drive at /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config
May 14 03:36:20.217689 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq6jrcz6t {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:20.259874 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq6jrcz6t" returned: 0 in 0.042s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:20.272463 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:20.526163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Attempting to attach volume d7161cfe-ddf4-4d20-aef2-720026ab2b64 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:36:20.528408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:   <alias name="ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64"/>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:   <serial>d7161cfe-ddf4-4d20-aef2-720026ab2b64</serial>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:20.528408 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:36:20.784679 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:36:20.784961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.545s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:20.786680 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:36:20.914517 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:20.947071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:20.947415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:21.083419 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:21.108542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:21.108542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:21.192337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f0ac7c74-1e7f-425f-b32c-843dc879c635 req-749335f4-510a-4464-8517-4a93cf2d8ae3 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:21.193762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f0ac7c74-1e7f-425f-b32c-843dc879c635 req-749335f4-510a-4464-8517-4a93cf2d8ae3 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:21.194621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f0ac7c74-1e7f-425f-b32c-843dc879c635 req-749335f4-510a-4464-8517-4a93cf2d8ae3 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:21.194621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f0ac7c74-1e7f-425f-b32c-843dc879c635 req-749335f4-510a-4464-8517-4a93cf2d8ae3 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:21.194777 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f0ac7c74-1e7f-425f-b32c-843dc879c635 req-749335f4-510a-4464-8517-4a93cf2d8ae3 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Processing event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:36:21.780666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:21.786764 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.789297 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.789297 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.789297 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.789297 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.789499 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.791656 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:36:21.791656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:36:21.791656 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:36:21.957286 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729781.9568472, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:21.957445 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Started (Lifecycle Event)
May 14 03:36:21.958974 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:36:21.963872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:36:21.967415 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance spawned successfully.
May 14 03:36:21.968092 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:36:22.324490 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:22.325296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:22.325296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] No VIF found with MAC fa:16:3e:8e:f1:03, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:22.382689 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005314949999046803 future=<Future at 0x79d0b01b2660 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:22.383206 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:22.383353 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.716120022000041 future=<Future at 0x79d0b841cd70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:22.383460 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.7159986199999366 future=<Future at 0x79d0b841cd70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:22.385555 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Emitting event <LifecycleEvent: 1778729767.3819973, 7ff50ead-8117-44fd-9be6-8ac88fa1f76d => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:22.387458 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] VM Stopped (Lifecycle Event)
May 14 03:36:22.460358 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:22.461854 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:22.475202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.475372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.476194 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.476440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.476900 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.477665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:22.890820 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 7ff50ead-8117-44fd-9be6-8ac88fa1f76d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:22.965539 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:36:22.965873 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729782.965655, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:22.965921 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Paused (Lifecycle Event)
May 14 03:36:22.983652 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Took 9.10 seconds to spawn the instance on the hypervisor.
May 14 03:36:22.983772 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:23.015929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:23.266853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:23.267137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:23.267270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:23.267385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:23.267496 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:23.267621 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-792dd84d-0a0c-48c9-b6e9-eacfc3a31e58 req-3f24bda9-8f90-46e0-bc59-a7f4da4b2577 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state None.
May 14 03:36:23.348181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:23.474447 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:23.480292 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729783.4799519, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:23.480451 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Resumed (Lifecycle Event)
May 14 03:36:23.497752 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Took 19.89 seconds to build instance.
May 14 03:36:23.578200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:23.888438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bce8fa21-8469-4b2a-b794-d39bdbdfd059 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.410s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:23.989317 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:23.990722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:24.000309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-461c967e-59b5-415b-9bc3-d9a27c8b3bb3 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.403s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:25.101592 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003667260000383976 future=<Future at 0x79d0b841cd70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:25.101592 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] Emitting event <LifecycleEvent: 1778729770.0993812, 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:25.101592 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:25.102203 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] VM Stopped (Lifecycle Event)
May 14 03:36:25.368980 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Rescuing
May 14 03:36:25.368980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:25.368980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:25.368980 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:25.488143 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:25.606036 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-266f1e95-6679-430f-83f9-dcd9d0566c6d tempest-ImageDependencyTests-1227918501 tempest-ImageDependencyTests-1227918501-project-member] [instance: 0f5ed23a-e72b-48d5-8f3c-a0d481fe37c6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:25.875079 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:26.013212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:26.013413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:26.261693 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:26.427731 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating instance_info_cache with network_info: [{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:26.516471 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Detaching volume d7161cfe-ddf4-4d20-aef2-720026ab2b64
May 14 03:36:26.584583 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Attempting to driver detach volume d7161cfe-ddf4-4d20-aef2-720026ab2b64 from mountpoint /dev/vdb
May 14 03:36:26.589769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Found disk vdb by alias ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:26.590594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Found disk vdb by alias ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:26.590798 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Attempting to detach device vdb from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:36:26.591106 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <alias name="ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64"/>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <serial>d7161cfe-ddf4-4d20-aef2-720026ab2b64</serial>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:26.591106 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:26.598533 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully detached device vdb from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the persistent domain config.
May 14 03:36:26.598533 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] (1/8): Attempting to detach device vdb with device alias ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64 from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:36:26.598763 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <alias name="ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64"/>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <serial>d7161cfe-ddf4-4d20-aef2-720026ab2b64</serial>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:26.598763 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:26.721335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:26.721566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:26.935666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:27.178714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729787.1784, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:36:27.180361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d7161cfe-ddf4-4d20-aef2-720026ab2b64 for instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:36:27.183344 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully detached device vdb from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the live domain config.
May 14 03:36:27.184378 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:27.184819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:27.185042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:27.185527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:27.185930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7161cfe-ddf4-4d20-aef2-720026ab2b64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:27.186146 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.218634 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.221174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04', '48')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', '44')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:27.221174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64', '45')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:27.222160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b00358a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:27.222160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:27.222160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Flush multipath device 330000000cd2ce704 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:27.225667 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Detaching volume 8a58d328-9987-4d02-9cd8-6203a8f70d61
May 14 03:36:27.259810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:27.275293 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to driver detach volume 8a58d328-9987-4d02-9cd8-6203a8f70d61 from mountpoint /dev/vdb
May 14 03:36:27.290596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-8a58d328-9987-4d02-9cd8-6203a8f70d61 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:27.293071 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-8a58d328-9987-4d02-9cd8-6203a8f70d61 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:27.293240 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Attempting to detach device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:36:27.293457 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <alias name="ua-8a58d328-9987-4d02-9cd8-6203a8f70d61"/>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <serial>8a58d328-9987-4d02-9cd8-6203a8f70d61</serial>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:27.293457 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:27.298941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:27.301027 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config.
May 14 03:36:27.301168 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] (1/8): Attempting to detach device vdb with device alias ua-8a58d328-9987-4d02-9cd8-6203a8f70d61 from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:36:27.301487 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <alias name="ua-8a58d328-9987-4d02-9cd8-6203a8f70d61"/>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <serial>8a58d328-9987-4d02-9cd8-6203a8f70d61</serial>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:27.301487 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:27.308196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:27.308196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:27.358162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:27.358335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:27.360606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:27.374542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:27.374869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:27.386790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.436062 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.40.100,3260]
May 14 03:36:27.436062 np0000000741 nova-compute[97948]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.40.100,3260] successful.
May 14 03:36:27.436062 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.465627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.482839 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.523274 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.50.100,3260]
May 14 03:36:27.523274 np0000000741 nova-compute[97948]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-d7161cfe-ddf4-4d20-aef2-720026ab2b64, portal: 192.168.50.100,3260] successful.
May 14 03:36:27.523274 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.546610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:27.546868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:27.547035 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] <== disconnect_volume: return (362ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:27.547215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:27.809419 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:36:27.913493 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729787.9129784, 3defa392-75f0-4f24-b15d-d14ec40200cf => ua-8a58d328-9987-4d02-9cd8-6203a8f70d61> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:36:27.914538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8a58d328-9987-4d02-9cd8-6203a8f70d61 for instance 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:36:27.917879 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config.
May 14 03:36:27.919132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:27.919492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:27.919836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:27.920393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:27.920971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a58d328-9987-4d02-9cd8-6203a8f70d61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:27.921411 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.959125 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:27.959787 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:27.960208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04', '48')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:27.960304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '41')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:27.963678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61', '40')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:27.963678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0037c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'): ({'sdb'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:27.963678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:27.964221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flush multipath device 3300000001120ecfc {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:28.002368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:28.016981 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.039430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:28.083410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:28.083410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:28.083410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:28.097216 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:28.097216 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:28.114314 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:28.116148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.156798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.40.100,3260]
May 14 03:36:28.156798 np0000000741 nova-compute[97948]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.40.100,3260] successful.
May 14 03:36:28.156798 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.178651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.191707 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.228808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.50.100,3260]
May 14 03:36:28.228808 np0000000741 nova-compute[97948]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-8a58d328-9987-4d02-9cd8-6203a8f70d61, portal: 192.168.50.100,3260] successful.
May 14 03:36:28.228808 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.255079 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:28.255338 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:28.255478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== disconnect_volume: return (335ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:28.255612 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:28.352258 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.375989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:28.376235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:28.381068 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:36:28.381068 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Claim successful on node np0000000741
May 14 03:36:28.597218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.622497 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.720482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.727348 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.843860 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:28.879813 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.895945 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:28.909232 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance destroyed successfully.
May 14 03:36:28.910681 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'numa_topology' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:28.910989 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99965549600006 future=<Future at 0x79d0b00abfe0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:28.914698 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.996964608000098 future=<Future at 0x79d0b00abfe0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:28.914698 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99680823000017 future=<Future at 0x79d0b00abfe0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:29.256502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-2434e4b3-4be5-4964-9534-519ad86fcacb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:29.256775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-2434e4b3-4be5-4964-9534-519ad86fcacb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:29.416218 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Attempting a stable device rescue
May 14 03:36:29.557130 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:36:29.562474 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:36:29.562474 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Creating image(s)
May 14 03:36:29.563213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:29.563213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:29.563509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:29.563737 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'trusted_certs' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:29.631992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57896814-46da-46fb-8257-cf89ad532130 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.618s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:29.765037 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:29.849345 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f9f3e5fb-7364-4f1d-bd64-1a0613ea0807 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.128s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:29.877198 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:29.877745 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:30.071422 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:30.071701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "c5d576416fde16a4755451353430c0c651713ad7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:30.072018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "c5d576416fde16a4755451353430c0c651713ad7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:30.267483 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:30.268908 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:30.268908 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:30.270853 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:30.272244 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:30.277385 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Attempting to detach device tap2434e4b3-4b from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:36:30.277385 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] detach device xml: <interface type="ethernet">
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:   <mac address="fa:16:3e:4c:e6:96"/>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:   <model type="virtio"/>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:   <driver name="qemu"/>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:   <mtu size="1372"/>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:   <target dev="tap2434e4b3-4b"/>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]: </interface>
May 14 03:36:30.277385 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:30.285673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:30.290698 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <name>instance-0000000d</name>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <uuid>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</uuid>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:09</nova:creationTime>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <nova:port uuid="2434e4b3-4be5-4964-9534-519ad86fcacb">
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <memory unit='KiB'>196608</memory>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <vcpu placement='static'>1</vcpu>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <resource>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <partition>/machine</partition>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </resource>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <sysinfo type='smbios'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='product'>OpenStack Nova</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='version'>33.1.0</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='serial'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='uuid'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <entry name='family'>Virtual Machine</entry>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <boot dev='hd'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <smbios mode='sysinfo'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <vmcoreinfo state='on'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <cpu mode='custom' match='exact' check='full'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <model fallback='forbid'>Nehalem</model>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <feature policy='require' name='hypervisor'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <clock offset='utc'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <on_poweroff>destroy</on_poweroff>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <on_reboot>restart</on_reboot>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <on_crash>destroy</on_crash>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <disk type='file' device='disk'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk' index='2'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <backingStore type='file' index='3'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:         <format type='raw'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:         <source file='/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:         <backingStore/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       </backingStore>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target dev='vda' bus='virtio'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='virtio-disk0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <disk type='file' device='cdrom'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <driver name='qemu' type='raw' cache='none'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config' index='1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <backingStore/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target dev='hda' bus='ide'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <readonly/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='ide0-0-0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <controller type='usb' index='0' model='none'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='usb'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <controller type='pci' index='0' model='pci-root'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='pci.0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <controller type='ide' index='0'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='ide'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <interface type='ethernet'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <mac address='fa:16:3e:8e:f1:03'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target dev='tap436c7406-82'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <model type='virtio'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <driver name='qemu'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <mtu size='1372'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='net0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <interface type='ethernet'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <mac address='fa:16:3e:4c:e6:96'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target dev='tap2434e4b3-4b'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <model type='virtio'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <driver name='qemu'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <mtu size='1372'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='net1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <serial type='pty'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target type='isa-serial' port='0'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:         <model name='isa-serial'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       </target>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <console type='pty' tty='/dev/pts/1'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <target type='serial' port='0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </console>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <input type='mouse' bus='ps2'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='input0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <input type='keyboard' bus='ps2'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='input1'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <listen type='address' address='0.0.0.0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <audio id='1' type='none'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <model type='virtio' heads='1' primary='yes'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='video0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <stats period='10'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='balloon0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <rng model='virtio'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <backend model='random'>/dev/urandom</backend>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <alias name='rng0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <label>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</label>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <imagelabel>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</imagelabel>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <label>+64055:+993</label>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:     <imagelabel>+64055:+993</imagelabel>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:30.290698 np0000000741 nova-compute[97948]:  {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 03:36:30.296197 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully detached device tap2434e4b3-4b from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the persistent domain config.
May 14 03:36:30.296197 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] (1/8): Attempting to detach device tap2434e4b3-4b with device alias net1 from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:36:30.296197 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] detach device xml: <interface type="ethernet">
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:   <mac address="fa:16:3e:4c:e6:96"/>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:   <model type="virtio"/>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:   <driver name="qemu"/>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:   <mtu size="1372"/>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:   <target dev="tap2434e4b3-4b"/>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]: </interface>
May 14 03:36:30.296197 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:30.380476 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:30.680909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:30.681953 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:30.683956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:30.683956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:30.684162 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:30.684277 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-75c81786-87cd-4ed6-b7b9-b2c6b2605e9c req-32766455-2969-456f-8620-1c4dff944896 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state rescuing.
May 14 03:36:30.705406 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:30.708222 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:30.708498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:30.806921 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.part --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:30.807392 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] 8e6efd52-5c8a-42a3-a1f4-8fff0481ef41 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:36:30.808087 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:36:30.809100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.part /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:30.890204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:30.890736 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:36:30.896932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.part /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.converted" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:30.903374 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:31.015410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7.converted --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:31.016192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "c5d576416fde16a4755451353430c0c651713ad7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.944s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:31.016610 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:31.020785 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:31.025672 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "c5d576416fde16a4755451353430c0c651713ad7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:31.025962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "c5d576416fde16a4755451353430c0c651713ad7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:31.026376 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:31.029704 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:31.030083 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:31.126240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:31.126885 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7,backing_fmt=raw /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:31.172546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5d576416fde16a4755451353430c0c651713ad7,backing_fmt=raw /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.rescue" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:31.173055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "c5d576416fde16a4755451353430c0c651713ad7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:31.173414 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'migration_context' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:31.251530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729791.2493515, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:36:31.251530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Start waiting for the detach event from libvirt for device tap2434e4b3-4b with device alias net1 for instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:36:31.251530 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:31.253727 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <name>instance-0000000d</name>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <uuid>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</uuid>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:09</nova:creationTime>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <nova:port uuid="2434e4b3-4be5-4964-9534-519ad86fcacb">
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <memory unit='KiB'>196608</memory>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <vcpu placement='static'>1</vcpu>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <resource>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <partition>/machine</partition>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </resource>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <sysinfo type='smbios'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='product'>OpenStack Nova</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='version'>33.1.0</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='serial'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='uuid'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <entry name='family'>Virtual Machine</entry>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <boot dev='hd'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <smbios mode='sysinfo'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <vmcoreinfo state='on'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <cpu mode='custom' match='exact' check='full'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <model fallback='forbid'>Nehalem</model>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <feature policy='require' name='hypervisor'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <clock offset='utc'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <on_poweroff>destroy</on_poweroff>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <on_reboot>restart</on_reboot>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <on_crash>destroy</on_crash>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <disk type='file' device='disk'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk' index='2'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <backingStore type='file' index='3'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:         <format type='raw'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:         <source file='/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:         <backingStore/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       </backingStore>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <target dev='vda' bus='virtio'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='virtio-disk0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <disk type='file' device='cdrom'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <driver name='qemu' type='raw' cache='none'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config' index='1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <backingStore/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <target dev='hda' bus='ide'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <readonly/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='ide0-0-0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <controller type='usb' index='0' model='none'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='usb'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <controller type='pci' index='0' model='pci-root'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='pci.0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <controller type='ide' index='0'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='ide'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <interface type='ethernet'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <mac address='fa:16:3e:8e:f1:03'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <target dev='tap436c7406-82'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <model type='virtio'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <driver name='qemu'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <mtu size='1372'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='net0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <serial type='pty'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <target type='isa-serial' port='0'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:         <model name='isa-serial'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       </target>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <console type='pty' tty='/dev/pts/1'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <target type='serial' port='0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </console>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <input type='mouse' bus='ps2'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='input0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <input type='keyboard' bus='ps2'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='input1'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <listen type='address' address='0.0.0.0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <audio id='1' type='none'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <model type='virtio' heads='1' primary='yes'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='video0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <stats period='10'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='balloon0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <rng model='virtio'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <backend model='random'>/dev/urandom</backend>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <alias name='rng0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <label>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</label>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <imagelabel>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</imagelabel>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <label>+64055:+993</label>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:     <imagelabel>+64055:+993</imagelabel>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:31.253727 np0000000741 nova-compute[97948]:  {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully detached device tap2434e4b3-4b from instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 from the live domain config.
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:31.258272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.266858 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.266858 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.267430 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2434e4b3-4b, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:31.272421 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.272421 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:31.283184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.290574 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.296343 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.298304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d587a658-9d71-4f22-a667-3569daf0083a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:31.299496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.300269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:31.318906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.320572 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.326348 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:31.330138 np0000000741 nova-compute[97948]: INFO os_vif [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b')
May 14 03:36:31.332071 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-105715718', uuid='8dbcc9c2-0ce8-4450-9772-a532b41e53f7'), owner=OwnerMeta(userid='82973e4b28774576bcce6851483a08f9', username='tempest-TaggedAttachmentsTest-1383375675-project-member', projectid='0bf8c09511e44fecb39453337950bdf2', projectname='tempest-TaggedAttachmentsTest-1383375675'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729791.3311946) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:31.332755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:31</nova:creationTime>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:31.332755 np0000000741 nova-compute[97948]:  {{(pid=97948) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 03:36:31.336335 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:31.336732 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:31.398385 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:36:31.398544 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:36:31.398780 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:31.398999 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:31.427621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:31.428389 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:31.498450 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c22726ed0c7244b6a428e2a6f49d9e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203276d61c614abaab90c3d9d6e99e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:36:31.508007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:31.508007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:31.508007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:31.508313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:31.510292 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:31.510574 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-667c9d21-b25a-407a-b52b-7f169bbc1670 req-1d2c5cb3-bac0-4c81-a74a-c7f2f2565266 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb for instance with vm_state active and task_state None.
May 14 03:36:31.677585 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:31.677585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:36:31.677585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start _get_guest_xml network_info=[{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:24:34:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8e6efd52-5c8a-42a3-a1f4-8fff0481ef41', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'f06ca3e4-a0f1-48d5-99a3-16d877adef99', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'serial': 'b7cf99b4-5a00-4acb-9757-5827b95dd477'}, 'boot_index': 0, 'attachment_id': '0b83a7df-825e-4fc1-8d21-fee554d17727', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:31.677895 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:31.902169 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:36:31.932796 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:32.072881 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Successfully created port: 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:36:32.183249 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:32.186926 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:32.190183 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012', uuid='f06ca3e4-a0f1-48d5-99a3-16d877adef99'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:24:34:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729792.1893518) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:32.192497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:32.194276 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:32.195652 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:32.196715 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:32.199514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:32.201490 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:32.202250 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:32.202371 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:32.202615 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:32.203188 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:32.203935 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:32.203935 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:32.204996 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:32.205271 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:32.205711 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:32.206407 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:32.207089 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'vcpu_model' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:32.405869 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:36:32.592798 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Successfully updated port: 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:36:32.713874 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:32.722853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:32.777701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:32.777968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:32.778191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:32.778311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:32.778469 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:32.778571 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state rescuing.
May 14 03:36:32.778705 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-changed-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:32.778814 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing instance network info cache due to event network-changed-9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:32.778955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:32.779066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:32.779163 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:32.809736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:32.810595 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:32.810595 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:32.810793 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:32.811065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:32.811422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:32.811554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:32.811858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:32.812105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:32.823781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:32.825163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:32.826766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:32.827039 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:32.828335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:32.828335 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:32.843219 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:32.843219 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:32.851041 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:32.851041 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:32.859112 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:32.860526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:32.876895 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:32.877529 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:32.877529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:32.881428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('9', '0', '0', 0) found on session 42 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:32.881540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:32.891928 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:32.892583 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:32.892583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:32.894142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:32.894142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 42 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:32.894142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:32.894345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('10', '0', '0', 0) found on session 43 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:32.894411 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:32.905505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 43 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:32.906027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:32.941605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:33.096434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:33.283118 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:33.354363 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:33.365971 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:33.395759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:33.395759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquired lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:33.395759 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:33.417845 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:36:33.418741 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:36:33.418994 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Creating image(s)
May 14 03:36:33.419378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:33.419565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:33.420633 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:33.421454 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:33.429853 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:33.435626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:33.527937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:33.531584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:33.533997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:33.534533 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:33.541170 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:33.541523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:33.561566 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:33.575551 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:33.575926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:33.576167 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:33.576313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:33.576465 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:33.576590 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received unexpected event network-vif-unplugged-2434e4b3-4be5-4964-9534-519ad86fcacb for instance with vm_state active and task_state None.
May 14 03:36:33.577057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-deleted-2434e4b3-4be5-4964-9534-519ad86fcacb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:33.577558 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Neutron deleted interface 2434e4b3-4be5-4964-9534-519ad86fcacb; detaching it from the instance and deleting it from the info cache
May 14 03:36:33.577829 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:33.628189 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:33.628599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:33.676571 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk 1073741824" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:33.677284 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:33.677778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:33.790261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:33.790939 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:36:33.791310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:33.828940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:36:33.899711 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:33.903269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:33.903918 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Cannot resize image /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:36:33.904257 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:36:33.904507 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Ensure instance console log exists: /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:36:33.905038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:33.905315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:33.905315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:34.034675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:34.034675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:34.034675 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attaching volume bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 to /dev/vdb
May 14 03:36:34.067796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff87195-d567-428a-a488-03e6058b67be req-e444b429-9d6f-41ab-b1bf-43d2b95aca94 service nova] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:34.068468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:34.068683 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:34.084359 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Lazy-loading 'system_metadata' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:34.091199 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:34.106717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:34.132845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:34.179945 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:34.180255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:34.193393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:34.195014 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe8e:f103', 'fe80::1ceb:41ff:fea3:b151', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe5f:d2a0', 'fe80::90da:47ff:fe9b:cd76', 'fe80::fc16:3eff:feb8:8558', 'fe80::fc16:3eff:fea1:a3ed', 'fe80::fc16:3eff:fe05:b1f3', 'fe80::fc16:3eff:fe15:20da', 'fe80::fc16:3eff:fe52:d17e', 'fe80::9c8e:a1ff:fe39:fba6', 'fe80::fc16:3eff:fe15:eaa0', 'fe80::10d3:9fff:fe74:6bfd', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e'] 
May 14 03:36:34.195173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:34.195228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:34.195462 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:34.195742 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating existing volume attachment record: e37b61ee-bbbf-4371-a771-6bf5c01591cb {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:34.363510 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:34.545066 np0000000741 nova-compute[97948]: INFO nova.network.neutron [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Port 2434e4b3-4be5-4964-9534-519ad86fcacb from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
May 14 03:36:34.545367 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:34.593693 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Lazy-loading 'flavor' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:34.652207 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:34.756514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:34.757026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:34.757192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:34.846762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Found WWN 3300000008cf33e27 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:34.846762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:34.846762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '3300000008cf33e27', 'path': '/dev/dm-1', 'multipath_id': '3300000008cf33e27'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:34.847124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008cf33e27', 'path': '/dev/dm-1', 'multipath_id': '3300000008cf33e27'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:34.849213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.092s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:34.849521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:34.864934 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:34.865387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:34.865778 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:34.866481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:34.867960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:34.867960 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:34.883355 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:34.883355 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:34.891456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:34.891456 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:34.898537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4] added
May 14 03:36:34.898537 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:34.898537 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:34.898537 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:34.898537 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:34.898537 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:34.898537 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:34.899154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:34.899154 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:34.899230 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:34.902255 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:34.905945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4] added
May 14 03:36:34.905945 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:34.905945 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:34.905945 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:34.905945 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:34.905945 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:34.905945 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:34.906178 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:34.906280 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:34.906395 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:35.048994 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Releasing lock "refresh_cache-8dbcc9c2-0ce8-4450-9772-a532b41e53f7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:35.095619 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:35.097504 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Object Instance<8dbcc9c2-0ce8-4450-9772-a532b41e53f7> lazy-loaded attributes: system_metadata,flavor {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:35.098377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:35.098377 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:35.099527 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:35.101138 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:35.102581 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <name>instance-0000000d</name>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <uuid>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</uuid>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:31</nova:creationTime>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <memory unit='KiB'>196608</memory>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <vcpu placement='static'>1</vcpu>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <resource>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <partition>/machine</partition>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </resource>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <sysinfo type='smbios'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='product'>OpenStack Nova</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='version'>33.1.0</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='serial'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='uuid'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <entry name='family'>Virtual Machine</entry>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <boot dev='hd'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <smbios mode='sysinfo'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <vmcoreinfo state='on'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <cpu mode='custom' match='exact' check='full'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <model fallback='forbid'>Nehalem</model>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <feature policy='require' name='hypervisor'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <clock offset='utc'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <on_poweroff>destroy</on_poweroff>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <on_reboot>restart</on_reboot>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <on_crash>destroy</on_crash>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <disk type='file' device='disk'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk' index='2'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <backingStore type='file' index='3'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:         <format type='raw'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:         <source file='/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:         <backingStore/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       </backingStore>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <target dev='vda' bus='virtio'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='virtio-disk0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <disk type='file' device='cdrom'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <driver name='qemu' type='raw' cache='none'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config' index='1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <backingStore/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <target dev='hda' bus='ide'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <readonly/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='ide0-0-0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <controller type='usb' index='0' model='none'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='usb'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <controller type='pci' index='0' model='pci-root'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='pci.0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <controller type='ide' index='0'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='ide'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <interface type='ethernet'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <mac address='fa:16:3e:8e:f1:03'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <target dev='tap436c7406-82'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <model type='virtio'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <driver name='qemu'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <mtu size='1372'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='net0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <serial type='pty'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <target type='isa-serial' port='0'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:         <model name='isa-serial'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       </target>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <console type='pty' tty='/dev/pts/1'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <target type='serial' port='0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </console>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <input type='mouse' bus='ps2'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='input0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <input type='keyboard' bus='ps2'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='input1'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <listen type='address' address='0.0.0.0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <audio id='1' type='none'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <model type='virtio' heads='1' primary='yes'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='video0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <stats period='10'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='balloon0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <rng model='virtio'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <backend model='random'>/dev/urandom</backend>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <alias name='rng0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <label>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</label>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <imagelabel>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</imagelabel>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <label>+64055:+993</label>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:     <imagelabel>+64055:+993</imagelabel>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:35.102581 np0000000741 nova-compute[97948]:  {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface> {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:e6:96"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2434e4b3-4b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <name>instance-0000000d</name>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <uuid>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</uuid>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:31</nova:creationTime>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <memory unit='KiB'>196608</memory>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <vcpu placement='static'>1</vcpu>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <resource>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <partition>/machine</partition>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </resource>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <sysinfo type='smbios'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='product'>OpenStack Nova</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='version'>33.1.0</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='serial'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='uuid'>8dbcc9c2-0ce8-4450-9772-a532b41e53f7</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <entry name='family'>Virtual Machine</entry>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <boot dev='hd'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <smbios mode='sysinfo'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <vmcoreinfo state='on'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <cpu mode='custom' match='exact' check='full'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <model fallback='forbid'>Nehalem</model>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <feature policy='require' name='hypervisor'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <clock offset='utc'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <on_poweroff>destroy</on_poweroff>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <on_reboot>restart</on_reboot>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <on_crash>destroy</on_crash>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <disk type='file' device='disk'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk' index='2'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <backingStore type='file' index='3'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:         <format type='raw'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:         <source file='/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:         <backingStore/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       </backingStore>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <target dev='vda' bus='virtio'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='virtio-disk0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <disk type='file' device='cdrom'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <driver name='qemu' type='raw' cache='none'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <source file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/disk.config' index='1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <backingStore/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <target dev='hda' bus='ide'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <readonly/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='ide0-0-0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <controller type='usb' index='0' model='none'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='usb'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <controller type='pci' index='0' model='pci-root'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='pci.0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <controller type='ide' index='0'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='ide'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </controller>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <interface type='ethernet'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <mac address='fa:16:3e:8e:f1:03'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <target dev='tap436c7406-82'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <model type='virtio'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <driver name='qemu'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <mtu size='1372'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='net0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <serial type='pty'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <target type='isa-serial' port='0'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:         <model name='isa-serial'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       </target>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <console type='pty' tty='/dev/pts/1'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <source path='/dev/pts/1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <log file='/opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7/console.log' append='off'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <target type='serial' port='0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='serial0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </console>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <input type='mouse' bus='ps2'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='input0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <input type='keyboard' bus='ps2'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='input1'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </input>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <listen type='address' address='0.0.0.0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </graphics>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <audio id='1' type='none'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <model type='virtio' heads='1' primary='yes'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='video0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <stats period='10'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='balloon0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <rng model='virtio'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <backend model='random'>/dev/urandom</backend>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <alias name='rng0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <label>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</label>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <imagelabel>libvirt-8dbcc9c2-0ce8-4450-9772-a532b41e53f7</imagelabel>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <label>+64055:+993</label>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:     <imagelabel>+64055:+993</imagelabel>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:   </seclabel>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:35.109820 np0000000741 nova-compute[97948]:  {{(pid=97948) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Detaching interface fa:16:3e:4c:e6:96 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2434e4b3-4b' not found.
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000741',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Converting VIF {"id": "2434e4b3-4be5-4964-9534-519ad86fcacb", "address": "fa:16:3e:4c:e6:96", "network": {"id": "3d875d0a-bed8-4c8a-9609-adc7526c96a8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392266940", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2434e4b3-4b", "ovs_interfaceid": "2434e4b3-4be5-4964-9534-519ad86fcacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:35.109820 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:35.117255 np0000000741 nova-compute[97948]: DEBUG os_vif [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:35.117255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:35.117255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2434e4b3-4b, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:35.117255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:35.118198 np0000000741 nova-compute[97948]: INFO os_vif [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e6:96,bridge_name='br-int',has_traffic_filtering=True,id=2434e4b3-4be5-4964-9534-519ad86fcacb,network=Network(3d875d0a-bed8-4c8a-9609-adc7526c96a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2434e4b3-4b')
May 14 03:36:35.119171 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-105715718', uuid='8dbcc9c2-0ce8-4450-9772-a532b41e53f7'), owner=OwnerMeta(userid='82973e4b28774576bcce6851483a08f9', username='tempest-TaggedAttachmentsTest-1383375675-project-member', projectid='0bf8c09511e44fecb39453337950bdf2', projectname='tempest-TaggedAttachmentsTest-1383375675'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729795.1188035) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:35.119657 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [req-ab8975dc-2af6-415c-b85a-87df172b708e req-a8bbd585-7815-4468-892b-c4e4378787fc service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:package version="33.1.0"/>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:name>tempest-device-tagging-server-105715718</nova:name>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:creationTime>2026-05-14 03:36:35</nova:creationTime>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:flavor name="m1.nano" id="42">
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:memory>192</nova:memory>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:disk>1</nova:disk>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:swap>0</nova:swap>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:vcpus>1</nova:vcpus>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:extraSpecs>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     </nova:extraSpecs>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   </nova:flavor>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:minDisk>1</nova:minDisk>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:minRam>0</nova:minRam>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:properties>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     </nova:properties>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   </nova:image>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:owner>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:user uuid="82973e4b28774576bcce6851483a08f9">tempest-TaggedAttachmentsTest-1383375675-project-member</nova:user>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:project uuid="0bf8c09511e44fecb39453337950bdf2">tempest-TaggedAttachmentsTest-1383375675</nova:project>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   </nova:owner>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   <nova:ports>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     <nova:port uuid="436c7406-82ac-4fb5-bcd8-5039846e810a">
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:     </nova:port>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:   </nova:ports>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]: </nova:instance>
May 14 03:36:35.119657 np0000000741 nova-compute[97948]:  {{(pid=97948) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 03:36:35.356871 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-2101756012',id=18,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:22Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-hv6r7xmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:23Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=f06ca3e4-a0f1-48d5-99a3-16d877adef99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:24:34:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:35.357162 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:24:34:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:35.357534 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:35.358145 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:35.553714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9ff75a4-7871-444d-8b13-db8e011dfbb7 tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "interface-8dbcc9c2-0ce8-4450-9772-a532b41e53f7-2434e4b3-4be5-4964-9534-519ad86fcacb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.297s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:35.600200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:35.600502 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance network_info: |[{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:36:35.603174 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start _get_guest_xml network_info=[{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:35.605946 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:35.607536 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2053616745', uuid='646c78c0-bf19-4d90-80ed-e79836dc0ecf'), owner=OwnerMeta(userid='c22726ed0c7244b6a428e2a6f49d9e07', username='tempest-ServerStableDeviceRescueTest-1584222625-project-member', projectid='203276d61c614abaab90c3d9d6e99e0e', projectname='tempest-ServerStableDeviceRescueTest-1584222625'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729795.6071591) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:35.608867 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:35.609406 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:35.610528 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:35.610824 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:35.611983 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:35.612496 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:35.612752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:35.612907 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:35.613729 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:35.613729 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:35.614582 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:35.614778 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:35.614973 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:35.615189 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:35.615394 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:35.615610 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:35.638392 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2053616745',display_name='tempest-ServerStableDeviceRescueTest-server-2053616745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverstabledevicerescuetest-server-2053616745',id=19,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOehng1ilN6xqQk2M0LzjjdlGsdHiekcawpTfGWtNTCkZBR2H6IUvn/vOdjKk0dQxjkhax8hhlAK4q0kgWTk4/A46IvTm6uLKWVFxX2k0jchU58RoM6BWd+tZrVtbDN35w==',key_name='tempest-keypair-1256657895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203276d61c614abaab90c3d9d6e99e0e',ramdisk_id='',reservation_id='r-2hifa2g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1584222625',owner_user_name='tempest-ServerStableDeviceRescueTest-1584222625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c22726ed0c7244b6a428e2a6f49d9e07',uuid=646c78c0-bf19-4d90-80ed-e79836dc0ecf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:35.638392 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converting VIF {"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:35.639832 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:35.640825 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'pci_devices' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:35.867123 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:35.868491 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <uuid>f06ca3e4-a0f1-48d5-99a3-16d877adef99</uuid>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <name>instance-00000012</name>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2101756012</nova:name>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:32</nova:creationTime>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         <nova:port uuid="4152108d-8740-489b-ae2f-66c9ab88a526">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="serial">f06ca3e4-a0f1-48d5-99a3-16d877adef99</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="uuid">f06ca3e4-a0f1-48d5-99a3-16d877adef99</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <alias name="ua-b7cf99b4-5a00-4acb-9757-5827b95dd477"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <serial>b7cf99b4-5a00-4acb-9757-5827b95dd477</serial>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.rescue"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <boot order="1"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:24:34:56"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <target dev="tap4152108d-87"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/console.log" append="off"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:35.868491 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:35.875781 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance destroyed successfully.
May 14 03:36:35.900150 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:35.906973 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:35.917864 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:35.917864 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:35.923907 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:35.923907 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:35.934591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:35.944944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:35.964460 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:35.964897 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:35.978925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:36.021803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.50.100,3260]
May 14 03:36:36.021803 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.50.100,3260] successful.
May 14 03:36:36.021803 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:36.028295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.40.100,3260]
May 14 03:36:36.028295 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.40.100,3260] successful.
May 14 03:36:36.028295 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:36.038361 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:36.049588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.066536 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.067058 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:36.067058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:36.067517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:36.068492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('8', '-', '-', 0) found on session 50 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:36.068840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.079497 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8d8268b-5133-4339-9170-4abb97879245 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eaf3b001-e48c-4cd2-9d3d-91d99c305c04 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:36.080057 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:36.080057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:36.080319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:36.081409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('11', '-', '-', 0) found on session 51 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:36.081529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:36.098925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 50 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:36.099106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:36.114383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 51 and hctl ['11', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <uuid>646c78c0-bf19-4d90-80ed-e79836dc0ecf</uuid>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <name>instance-00000013</name>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2053616745</nova:name>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:35</nova:creationTime>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:user uuid="c22726ed0c7244b6a428e2a6f49d9e07">tempest-ServerStableDeviceRescueTest-1584222625-project-member</nova:user>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:project uuid="203276d61c614abaab90c3d9d6e99e0e">tempest-ServerStableDeviceRescueTest-1584222625</nova:project>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         <nova:port uuid="9acf5057-6375-40ad-b805-32e6e0890442">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="serial">646c78c0-bf19-4d90-80ed-e79836dc0ecf</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="uuid">646c78c0-bf19-4d90-80ed-e79836dc0ecf</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:21:f6:2f"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <target dev="tap9acf5057-63"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/console.log" append="off"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:36.145691 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Preparing to wait for external event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:36.145691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:36.150281 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2053616745',display_name='tempest-ServerStableDeviceRescueTest-server-2053616745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverstabledevicerescuetest-server-2053616745',id=19,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOehng1ilN6xqQk2M0LzjjdlGsdHiekcawpTfGWtNTCkZBR2H6IUvn/vOdjKk0dQxjkhax8hhlAK4q0kgWTk4/A46IvTm6uLKWVFxX2k0jchU58RoM6BWd+tZrVtbDN35w==',key_name='tempest-keypair-1256657895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203276d61c614abaab90c3d9d6e99e0e',ramdisk_id='',reservation_id='r-2hifa2g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1584222625',owner_user_name='tempest-ServerStableDeviceRescueTest-1584222625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c22726ed0c7244b6a428e2a6f49d9e07',uuid=646c78c0-bf19-4d90-80ed-e79836dc0ecf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:36.151861 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converting VIF {"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:36.152480 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:36.152818 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:36.154012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:36.154012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:36.154201 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:36.156947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:36.157153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26485a7f-df20-544e-a051-47332d24a637', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:36.163421 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:36.173119 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:36.177248 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:36.177389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9acf5057-63, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:36.178774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9acf5057-63, col_values=(('qos', UUID('732d4d9c-a568-4a37-9846-1c2059e979bb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:36.178774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9acf5057-63, col_values=(('external_ids', {'iface-id': '9acf5057-6375-40ad-b805-32e6e0890442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:f6:2f', 'vm-uuid': '646c78c0-bf19-4d90-80ed-e79836dc0ecf'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:36.187210 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:36.196052 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:36.198261 np0000000741 nova-compute[97948]: INFO os_vif [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63')
May 14 03:36:37.114903 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 51 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:37.115506 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:37.190124 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:37.190375 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:37.190593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:37.190803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:37.190949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:37.194983 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Terminating instance
May 14 03:36:37.394511 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:37.394683 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:37.396806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:37.396806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:24:34:56, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:37.396806 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Using config drive
May 14 03:36:37.699141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:36:37.719941 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:37.720092 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:37.720219 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No VIF found with MAC fa:16:3e:21:f6:2f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:37.720656 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Using config drive
May 14 03:36:37.743711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.747122 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.772179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.777656 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.800425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.820782 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:37.884521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found WWN 3300000009dad74d2 for multipath device dm-4 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:37.884890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:37.885226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== connect_volume: return (3127ms) {'type': 'block', 'scsi_wwn': '3300000009dad74d2', 'path': '/dev/dm-4', 'multipath_id': '3300000009dad74d2'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:37.885699 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009dad74d2', 'path': '/dev/dm-4', 'multipath_id': '3300000009dad74d2'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:37.889255 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:37.900038 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'ec2_ids' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:37.911756 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:37.914195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:37.914195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:37.914195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:37.914195 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:37.914195 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7309994-1ad4-4f7a-ac6d-88216ea85406 req-e5ee8b9c-4249-4944-bb5b-6cc66200b912 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:38.060843 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999722199999951 future=<Future at 0x79d0b01e9af0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:38.062599 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Instance destroyed successfully.
May 14 03:36:38.063121 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lazy-loading 'resources' on Instance uuid 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:38.226147 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:38.357668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.376952 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Creating config drive at /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config
May 14 03:36:38.380990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprp_ck29z {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:38.396953 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to attach volume bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:36:38.399794 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:   <alias name="ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4"/>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:   <serial>bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4</serial>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:38.399794 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:36:38.414378 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:38.414573 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'keypairs' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:38.431809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprp_ck29z" returned: 0 in 0.051s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:38.494361 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:36:38.567714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-105715718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-105715718',id=13,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnA2wZ07YHaSgVGJVfuQQS6eh647G3iDEM3VLdtIWWNe8yOJXpjWj3AlVmAvFEJ+Ns8ftp+iskVr2pW5QymizHieRmfFdbN9w6fPvPckC88MgiY2vEs+XjaHJD3i11T7Q==',key_name='tempest-keypair-425910929',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:19Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf8c09511e44fecb39453337950bdf2',ramdisk_id='',reservation_id='r-i29toawn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1383375675',owner_user_name='tempest-TaggedAttachmentsTest-1383375675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82973e4b28774576bcce6851483a08f9',uuid=8dbcc9c2-0ce8-4450-9772-a532b41e53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:38.567714 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converting VIF {"id": "436c7406-82ac-4fb5-bcd8-5039846e810a", "address": "fa:16:3e:8e:f1:03", "network": {"id": "cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1271999307-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bf8c09511e44fecb39453337950bdf2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c7406-82", "ovs_interfaceid": "436c7406-82ac-4fb5-bcd8-5039846e810a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:38.567930 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:38.568188 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:38.570232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.572412 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap436c7406-82, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:38.578577 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.578577 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:38.588678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.592456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.592456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=797abdee-bcc4-45fa-a6af-ebca4ec9e20e) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:38.594717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.594717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:38.605733 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:38.610651 np0000000741 nova-compute[97948]: INFO os_vif [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f1:03,bridge_name='br-int',has_traffic_filtering=True,id=436c7406-82ac-4fb5-bcd8-5039846e810a,network=Network(cd4bb0de-819c-4d8d-821e-bca1a4dcb3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c7406-82')
May 14 03:36:38.610651 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Deleting instance files /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7_del
May 14 03:36:38.610651 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Deletion of /opt/stack/data/nova/instances/8dbcc9c2-0ce8-4450-9772-a532b41e53f7_del complete
May 14 03:36:38.920730 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:38.930939 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:39.056467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.098863 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.112909 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Creating config drive at /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config.rescue
May 14 03:36:39.115710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6coe77n_ {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:39.139966 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Took 1.44 seconds to destroy the instance on the hypervisor.
May 14 03:36:39.141441 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:36:39.142394 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:36:39.142509 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:36:39.143437 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:39.176188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6coe77n_" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:39.206779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.266825 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:39.449331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.458066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.466577 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.506941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.512144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.783371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.813672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.818752 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.912156 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.932836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.934088 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:39.992088 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:39.994991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:39.995319 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:39.995484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:39.995700 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:39.995877 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-80acaada-bf9f-4d30-8257-deaa190af45f req-0b057954-8633-4c01-9c5e-27e1a69220b9 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state rescuing.
May 14 03:36:40.002862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:40.003053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Acquiring lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:40.003235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:40.003373 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:40.003494 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] No waiting events found dispatching network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:40.003682 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-unplugged-436c7406-82ac-4fb5-bcd8-5039846e810a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:40.003753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:40.003901 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:40.005536 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:40.005739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:40.006032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Processing event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:36:40.006032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:40.006216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:40.006216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:40.007622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:40.007768 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:40.007845 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state building and task_state spawning.
May 14 03:36:40.007965 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Received event network-vif-deleted-436c7406-82ac-4fb5-bcd8-5039846e810a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:40.008106 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Neutron deleted interface 436c7406-82ac-4fb5-bcd8-5039846e810a; detaching it from the instance and deleting it from the info cache
May 14 03:36:40.008231 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:40.086944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:40.087767 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:40.087767 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:40.088478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No VIF found with MAC fa:16:3e:06:b4:3a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:40.341495 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:40.511811 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af1560fa-20d8-4756-a0bf-0baa8b543948 req-9858613f-74ef-43e4-877e-e467981af8b7 service nova] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Detach interface failed, port_id=436c7406-82ac-4fb5-bcd8-5039846e810a, reason: Instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:36:40.618885 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:36:40.620358 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729800.619774, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:40.620546 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Started (Lifecycle Event)
May 14 03:36:40.626592 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:36:40.632113 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance spawned successfully.
May 14 03:36:40.633271 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:36:40.839428 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b144b870-56cc-4b60-82b8-254e8407289d tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:40.849323 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Took 1.71 seconds to deallocate network for instance.
May 14 03:36:41.124603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:41.127142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:41.142723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.142900 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.143380 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.143750 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.144119 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.144491 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:36:41.360414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:41.360979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:41.630253 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:36:41.630499 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729801.630309, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:41.630576 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Paused (Lifecycle Event)
May 14 03:36:41.651369 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Took 8.23 seconds to spawn the instance on the hypervisor.
May 14 03:36:41.651369 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:41.660107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-415a032d-a60d-4efb-8379-700d4f9e2db4 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.626s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:41.919417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:41.919768 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:42.095748 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:42.095996 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:42.096218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:42.096407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:42.096722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:42.096810 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9ef69f10-a102-4ef3-ba96-dd77af8fbb87 req-50bade06-2aab-4889-bc81-abcb44870b34 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state rescued and task_state None.
May 14 03:36:42.132715 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:42.134654 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729802.1343462, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:42.134793 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Resumed (Lifecycle Event)
May 14 03:36:42.164206 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Took 13.85 seconds to build instance.
May 14 03:36:42.422721 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:42.640730 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:42.642285 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:42.673347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b800cdaa-352a-48eb-838d-81c2d83ebdab tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.366s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:42.771077 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Unrescuing
May 14 03:36:42.771314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:42.771462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:42.771588 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:42.933723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.571s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:42.996674 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Deleted allocations for instance 8dbcc9c2-0ce8-4450-9772-a532b41e53f7
May 14 03:36:43.144460 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for f06ca3e4-a0f1-48d5-99a3-16d877adef99 due to new event <LifecycleEvent: 1778729803.1440048, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:36:43.144666 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729803.1440048, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:43.144798 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Resumed (Lifecycle Event)
May 14 03:36:43.275227 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:43.362551 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:43.593728 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:43.649626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:43.655403 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:43.688335 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:43.718171 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-changed-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:43.719516 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing instance network info cache due to event network-changed-9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:43.719516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:43.719516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:43.719516 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:43.869968 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating instance_info_cache with network_info: [{"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:43.911303 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003999799998837261 future=<Future at 0x79d0b00abfe0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:43.911303 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:43.911303 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.147956216000011 future=<Future at 0x79d0b01e9af0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:43.911303 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.147864267999921 future=<Future at 0x79d0b01e9af0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:44.011116 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ff729690-ecfe-4ba0-85bc-ad76af85578b tempest-TaggedAttachmentsTest-1383375675 tempest-TaggedAttachmentsTest-1383375675-project-member] Lock "8dbcc9c2-0ce8-4450-9772-a532b41e53f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.820s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:44.157966 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:36:44.158175 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729804.158008, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:44.158278 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Started (Lifecycle Event)
May 14 03:36:44.223485 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:44.373556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-f06ca3e4-a0f1-48d5-99a3-16d877adef99" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:44.373556 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'flavor' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:44.642458 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:44.662013 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:44.663727 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:44.844893 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updated VIF entry in instance network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:36:44.844893 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:44.916768 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:44.921327 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:44.961842 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:45.106188 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:45.113049 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:45.166493 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:36:45.284286 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999669762999929 future=<Future at 0x79d0b02158e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:45.294289 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance destroyed successfully.
May 14 03:36:45.295523 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'numa_topology' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:45.349004 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8325cc0-4577-49fd-b284-3e7ed95da495 req-4a34be9c-7c27-4c7f-a0ec-d4de753b0d79 service nova] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:45.358524 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:45.358769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:45.358967 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:45.359939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:45.359939 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:45.359939 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3b6439d0-ec48-4515-9056-7aeefb63abc9 req-159a676a-0063-413c-89ea-edd431f0f70f service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state rescued and task_state unrescuing.
May 14 03:36:45.390032 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:45.802032 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<f06ca3e4-a0f1-48d5-99a3-16d877adef99> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:46.137497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:46.137992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:46.246235 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.276690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.282629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.380126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.417965 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.418681 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:46.518913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:46.519346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:46.643311 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Detaching volume bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4
May 14 03:36:46.687580 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to driver detach volume bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 from mountpoint /dev/vdb
May 14 03:36:46.695221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:46.696822 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:36:46.696950 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Attempting to detach device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:36:46.697262 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <alias name="ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4"/>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <serial>bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4</serial>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:46.697262 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:46.705222 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:46.706548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:46.712966 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config.
May 14 03:36:46.713120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] (1/8): Attempting to detach device vdb with device alias ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:36:46.713360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <alias name="ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4"/>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <serial>bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4</serial>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:46.713360 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:36:47.023552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:36:47.214577 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:47.273582 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for f06ca3e4-a0f1-48d5-99a3-16d877adef99 due to new event <LifecycleEvent: 1778729807.2731178, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:36:47.273746 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729807.2731178, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:47.273865 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Resumed (Lifecycle Event)
May 14 03:36:47.280092 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-be0c479b-182d-49a1-a288-499a6527682c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:47.464750 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:47.464920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:47.465565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:47.465727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:47.465789 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:47.466037 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state None.
May 14 03:36:47.466037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:47.466210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:47.466313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:47.466445 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:47.466703 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:47.466703 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state None.
May 14 03:36:47.466951 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:47.467110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:47.467271 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:47.467392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:47.467572 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:47.467982 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6371b44b-e89f-46ba-9cfd-15ab81be2970 req-a4a7977c-6e6c-437f-a24a-19b058813efb service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state None.
May 14 03:36:47.485427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 for instance 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:36:47.591220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:47.591220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:47.596942 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:36:47.597155 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Claim successful on node np0000000741
May 14 03:36:47.777958 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:47.779602 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:48.224223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:48.282500 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729808.282141, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:48.282685 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Started (Lifecycle Event)
May 14 03:36:48.360088 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:48.514812 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:48.595017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:48.786400 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:48.791933 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:36:49.129208 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:49.129452 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:49.295248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729809.2949033, 3defa392-75f0-4f24-b15d-d14ec40200cf => ua-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:36:49.298413 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config.
May 14 03:36:49.299544 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:49.299664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:49.299845 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:49.300572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:49.300572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:49.300725 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:49.318003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:49.318246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:49.318501 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attaching volume f45268d7-fef7-4c09-80f4-42bf858fa27d to /dev/vdb
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:49.333432 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4 (non-flash)
May 14 03:36:49.333819 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:49.335756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', '51')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:49.337491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', '51')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:49.338735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4', '50')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:49.339965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01eca40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:49.339965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Removing multipathed devices sdc, sdf {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:49.340237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flush multipath device 3300000009dad74d2 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:49.370891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:49.406203 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:49.414125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:49.427419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:49.454776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:49.470611 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if SCSI volumes sdc, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:49.471813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] SCSI volumes sdc, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:49.473340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if device paths {'sdc', 'sdf'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:49.488856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Device paths {'sdc', 'sdf'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:49.488856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:49.492823 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:49.493167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:49.503104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:49.503569 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:49.506525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.508170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:49.509377 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe5f:d2a0', 'fe80::90da:47ff:fe9b:cd76', 'fe80::fc16:3eff:feb8:8558', 'fe80::fc16:3eff:fea1:a3ed', 'fe80::fc16:3eff:fe05:b1f3', 'fe80::fc16:3eff:fe15:20da', 'fe80::fc16:3eff:fe52:d17e', 'fe80::9c8e:a1ff:fe39:fba6', 'fe80::fc16:3eff:fe15:eaa0', 'fe80::10d3:9fff:fe74:6bfd', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456'] 
May 14 03:36:49.509520 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:49.509662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:49.509884 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:49.510083 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating existing volume attachment record: 1cb3df95-0535-4780-bd42-c4d69f837257 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:49.555007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.40.100,3260]
May 14 03:36:49.555007 np0000000741 nova-compute[97948]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.40.100,3260] successful.
May 14 03:36:49.555007 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.573212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.583590 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.617959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.50.100,3260]
May 14 03:36:49.617959 np0000000741 nova-compute[97948]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-bdeeaa01-020b-44b6-8d4a-ca46f5c34bc4, portal: 192.168.50.100,3260] successful.
May 14 03:36:49.617959 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.632608 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:49.640052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:49.643336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:49.643336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== disconnect_volume: return (341ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:49.643336 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:50.007358 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:36:50.076112 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:50.076537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:50.076793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:50.077210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:50.077481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:50.091851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:50.092564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:50.093059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:50.093590 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:50.094669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:50.094669 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:50.105309 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:50.105309 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:50.112832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:50.112832 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:50.118440 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d] added
May 14 03:36:50.118440 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:50.118440 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:50.118440 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:50.118440 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:50.118440 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:50.118440 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:50.118991 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:50.118991 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:50.120018 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:50.124996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d] added
May 14 03:36:50.124996 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:50.124996 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:50.124996 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:50.124996 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:50.124996 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:50.124996 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:50.125214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:50.125416 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:50.125497 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:50.141805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.551s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:50.142294 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:36:50.203668 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:50.469650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:50.470015 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:50.470272 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:50.470416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:50.470586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:50.473285 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Terminating instance
May 14 03:36:50.577902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:50.578079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:50.581262 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:36:50.581421 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Claim successful on node np0000000741
May 14 03:36:50.652415 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:36:50.652415 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:36:50.652415 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:50.652415 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:50.765787 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cab6a4d716840acaf09bbecaaa536d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4aa2dbc46bc4fd7bb84c997a0a07ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:36:50.846857 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:50.978726 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:36:51.009377 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.017607 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.038629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.060826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.084386 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.085993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.090846 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.123897 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:51.128325 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:51.137925 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:51.137925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:51.147565 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:51.147565 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.153582 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:36:51.156957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.163496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.182667 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:51.189428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.201825 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:51.214926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3909a6c-30b9-4c92-915a-26611dad47d7 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.075s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:51.236659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260]
May 14 03:36:51.236659 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260] successful.
May 14 03:36:51.236659 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.252362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.285585 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260]
May 14 03:36:51.285585 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260] successful.
May 14 03:36:51.285585 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.292719 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:51.292719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:51.294039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('7', '-', '-', 0) found on session 52 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:51.294189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:51.303298 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:51.333731 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.341059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 52 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:51.341059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.344077 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:51.344507 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:51.344948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:51.344948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:51.346513 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('8', '-', '-', 0) found on session 53 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:51.347712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:51.375857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 53 and hctl ['8', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:51.395304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.400829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:51.447357 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33953929-d981-498a-a687-349bd85f9c58 req-6cd3ed8d-61e5-4dea-984f-bb332875b215 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:51.474945 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.507762 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:51.510144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:51.510144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:51.510144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:51.510144 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:51.510144 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4457767-9304-4020-9f0a-8045655c41c8 req-9958bbb8-fefa-498e-97c5-aefad98ae766 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:51.513273 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999646780000148 future=<Future at 0x79d0b0214680 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:51.520194 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Instance destroyed successfully.
May 14 03:36:51.521315 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lazy-loading 'resources' on Instance uuid 49558f8d-c20a-4fce-80c6-7959b0ade9ff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:51.560932 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.630589 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:51.658625 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:51.659466 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:36:51.667145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:51.667145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:51.667145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:51.667145 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:51.667145 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6a1f30c-ea55-4259-8c24-d828d71fc78a req-acc7fc26-f23c-4f8c-a1a3-c22572eaec54 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:52.027082 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.029241 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "ab798e2b-be0a-492d-9b09-98a7b7225055", "address": "fa:16:3e:5f:d2:a0", "network": {"id": "6b1e9d7d-95b1-47b5-b80b-88af8b86213d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-928058641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab798e2b-be", "ovs_interfaceid": "ab798e2b-be0a-492d-9b09-98a7b7225055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.030152 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.030654 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.034962 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.034962 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab798e2b-be, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.038542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.038542 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.074027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.077776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.083594 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Successfully created port: 7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:36:52.085479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da6a57d9-a1e9-45f6-84d1-51bd95a2663a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.088030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.125554 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.129429 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=ab798e2b-be0a-492d-9b09-98a7b7225055,network=Network(6b1e9d7d-95b1-47b5-b80b-88af8b86213d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab798e2b-be')
May 14 03:36:52.129871 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.129871 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.130368 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.130816 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.134679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.136028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d31361a-05, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.137321 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.149549 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:36:52.149867 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:36:52.173736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.176083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.176467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ac0eb80-5ea1-4d45-bf47-11b3f24ebc69) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.178154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.205813 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.208027 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:85:58,bridge_name='br-int',has_traffic_filtering=True,id=7d31361a-05f8-48b4-86b6-a308841519b6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d31361a-05')
May 14 03:36:52.210844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.210844 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.210844 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.210844 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.214112 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.214227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65705ae3-ab, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.216616 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.237895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.239063 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.239242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f84a308-8557-4b7e-bbc7-06f9c6a13eb8) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.240710 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.262962 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.265973 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=65705ae3-abe6-46c8-8cd9-00e9ff42b480,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65705ae3-ab')
May 14 03:36:52.266604 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.266773 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.267238 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.267443 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.268155 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.268345 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap627a44d5-69, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.271772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.287806 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.290292 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.290739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cc39bb1-e9d5-4b45-a427-ccea09ce862c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.292105 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.294337 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.309138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.311360 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b1:f3,bridge_name='br-int',has_traffic_filtering=True,id=627a44d5-69b7-409d-b04d-d73bde9a4c24,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap627a44d5-69')
May 14 03:36:52.312208 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.312545 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.313120 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.313405 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.314432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.314615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7e11d12-da, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.316870 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.329963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.335003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.335283 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deab3f6e-1dd3-4deb-bac3-b1a3aff5a47e) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.338165 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.348253 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.351339 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:da,bridge_name='br-int',has_traffic_filtering=True,id=d7e11d12-da95-4f0b-8c38-d786307636f6,network=Network(7ed260f1-800f-4866-8bc4-e41b7fa7c5a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7e11d12-da')
May 14 03:36:52.351807 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.351807 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.352543 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.352543 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.353772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.353923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap643b4c43-b5, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.356275 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.363165 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.364599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.365217 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=365dedbf-25fd-4128-b7ec-08e586e9ccf0) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.366740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.367417 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.373996 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.376024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 53 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:52.376246 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:52.376892 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:7e,bridge_name='br-int',has_traffic_filtering=True,id=643b4c43-b59a-4d6c-a242-5832a584a375,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643b4c43-b5')
May 14 03:36:52.377632 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-228783713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-device-tagging-server-228783713',id=15,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdDMqXf620kKMBHHG6k2nqT/ozgeQFLicX/aifLH64wUImT7+Qsh6a6gSeITk2nxsI26vq1tQ8HnrsTIfF/T7Q2SOcgStFD4AZb68NZD4VvLfRbrBSqfFcwQkH3YL681w==',key_name='tempest-keypair-1308266575',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:59Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='346418886705456e9de817c5a6473e49',ramdisk_id='',reservation_id='r-h5iry380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762907854',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762907854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b38d1b2fe1e04b09af7f4ddf5440e24a',uuid=49558f8d-c20a-4fce-80c6-7959b0ade9ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:36:52.377829 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converting VIF {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:52.378374 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:52.378598 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:36:52.380023 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.380308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5053041-b6, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.383156 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.383745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.384921 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:52.385048 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=989c5122-06bd-4281-bc52-1649867b188c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:52.387475 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:52.390001 np0000000741 nova-compute[97948]: INFO os_vif [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ea:a0,bridge_name='br-int',has_traffic_filtering=True,id=f5053041-b640-4476-bb1b-eaa08f9cc4ef,network=Network(3aa9f79d-0cf1-423e-b97f-e886081f5255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5053041-b6')
May 14 03:36:52.393049 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:52.393389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:52.393538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:52.652524 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:36:52.676827 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:36:52.677880 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:36:52.678119 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Creating image(s)
May 14 03:36:52.678884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:52.679414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:52.680927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:52.681543 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:52.684752 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:52.686022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:52.777776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:52.778285 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:52.778900 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:52.779551 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:52.782053 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:52.782448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:52.893361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:52.893361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:52.957798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk 1073741824" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:52.958480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:52.959034 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:53.059262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:53.060376 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:36:53.060724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:53.061770 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.002533372000016243 future=<Future at 0x79d0b01e9af0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.062426 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778729798.0591395, 8dbcc9c2-0ce8-4450-9772-a532b41e53f7 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:36:53.062727 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.076959 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] VM Stopped (Lifecycle Event)
May 14 03:36:53.083790 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.2005863469998985 future=<Future at 0x79d0b02158e0 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.083963 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.200027710999848 future=<Future at 0x79d0b02158e0 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.084757 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.084964 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.427724286000057 future=<Future at 0x79d0b0214680 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.085064 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.427622608000092 future=<Future at 0x79d0b0214680 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:53.106366 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Successfully updated port: 7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:36:53.114747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found WWN 330000000e5aa0dba for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:53.115305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:53.115597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000e5aa0dba', 'path': '/dev/dm-0', 'multipath_id': '330000000e5aa0dba'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:53.115920 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5aa0dba', 'path': '/dev/dm-0', 'multipath_id': '330000000e5aa0dba'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:53.117678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.724s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:53.118879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1232e137-9536-4dfe-8d48-86b187100996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:53.118879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:53.121382 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:53.144759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.145326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.156470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.156912 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '53')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:53.156912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '32')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.157376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:53.157855 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Cannot resize image /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:36:53.162195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996', '31')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.162496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0720040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'): ({'sdh'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:53.162732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:53.162963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Flush multipath device 330000000c52a1125 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:53.163193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.583s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.163659 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:36:53.169189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:36:53.169669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Ensure instance console log exists: /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:36:53.169838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.170139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.170139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.226566 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:53.274151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:53.311461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:53.311620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:53.312794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:53.332827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:53.333114 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:53.345354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.361801 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:53.387727 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.40.100,3260]
May 14 03:36:53.387727 np0000000741 nova-compute[97948]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.40.100,3260] successful.
May 14 03:36:53.387727 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.405596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.419634 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.456114 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.50.100,3260]
May 14 03:36:53.456114 np0000000741 nova-compute[97948]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-1232e137-9536-4dfe-8d48-86b187100996, portal: 192.168.50.100,3260] successful.
May 14 03:36:53.456114 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.475371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.475607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:53.475782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== disconnect_volume: return (1082ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:53.475952 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:53.477423 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:53.477580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:53.477751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:53.478050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:53.478352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f8f542-acd2-44d3-a5a9-660b891fc660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:53.478458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.506221 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:53.506802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '53')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:53.506802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '34')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.508487 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660', '35')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.510228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b00358a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'): ({'sdl'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:53.510837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Removing multipathed devices sdk, sdl {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:53.511077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Flush multipath device 330000000f553714b {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:53.541876 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.542069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.544032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.544245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.544413 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.544518 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-65705ae3-abe6-46c8-8cd9-00e9ff42b480 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.544647 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.548628 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.549130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.549271 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.549322 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.549806 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.549806 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.549806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.549806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.549939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.550039 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.550141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-d7e11d12-da95-4f0b-8c38-d786307636f6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.550248 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.551065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.551468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.551582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.551791 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.552574 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.552799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.552960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:53.553312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.553474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.553607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.553758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.553890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-627a44d5-69b7-409d-b04d-d73bde9a4c24 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.554022 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-changed-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.554244 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Refreshing instance network info cache due to event network-changed-7ea71dcc-3436-473c-936d-1879902e6ccf. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:53.554400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquiring lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:53.554819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Acquired lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:53.554922 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Refreshing network info cache for port 7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:53.583152 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.583264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.583413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.583538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.584043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.584152 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-ab798e2b-be0a-492d-9b09-98a7b7225055 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.584298 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.584407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.584512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.584617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.584825 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.585278 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.585342 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.585410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.585507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.585602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.585745 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.585843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ef0b5ab1-bb2a-4c21-83b5-1044143a0036 req-5af81c19-0661-4a46-814c-3e2061e1033a service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-f5053041-b640-4476-bb1b-eaa08f9cc4ef for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.587910 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 8dbcc9c2-0ce8-4450-9772-a532b41e53f7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:53.609333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:53.613222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:53.635000 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attempting to attach volume f45268d7-fef7-4c09-80f4-42bf858fa27d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:36:53.636568 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:   <alias name="ua-f45268d7-fef7-4c09-80f4-42bf858fa27d"/>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:   <serial>f45268d7-fef7-4c09-80f4-42bf858fa27d</serial>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]: </disk>
May 14 03:36:53.636568 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:36:53.650136 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:53.665473 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:53.665998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:53.666979 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:53.674468 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:36:53.674468 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:36:53.675335 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:53.675616 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:53.683739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:53.684358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:53.697329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.737938 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.40.100,3260]
May 14 03:36:53.737938 np0000000741 nova-compute[97948]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.40.100,3260] successful.
May 14 03:36:53.737938 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.747519 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.748321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.748521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.748721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.749119 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.749457 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-7d31361a-05f8-48b4-86b6-a308841519b6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.749611 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.749782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.750077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.750219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.750280 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.750447 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.750619 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:53.750795 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Acquiring lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:53.750966 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:53.751337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:53.751337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] No waiting events found dispatching network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:36:53.751504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-31df6596-ec14-4c17-a602-632a4ea29421 req-bcd61df8-d17e-46f1-b32c-7ffe4e683737 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-unplugged-643b4c43-b59a-4d6c-a242-5832a584a375 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:36:53.755711 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.772086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.808472 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe2ffc6cce044f7ad75df57827bc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6177683ef84349e5a26042f334b26ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:36:53.812932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.50.100,3260]
May 14 03:36:53.812932 np0000000741 nova-compute[97948]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-b0f8f542-acd2-44d3-a5a9-660b891fc660, portal: 192.168.50.100,3260] successful.
May 14 03:36:53.812932 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.831900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:53.832304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:53.832367 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== disconnect_volume: return (354ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:53.832504 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:53.834149 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:36:53.834552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:53.834740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:53.835091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:53.835420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71342ded-3d4b-4074-8ce7-29512e63abfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:36:53.835630 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.869124 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsi session list stdout=tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:53.869525 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:53.869525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '53')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:36:53.869839 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '36')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.870916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc', '37')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:36:53.871989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b077fc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'): ({'sdn'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:36:53.872225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Removing multipathed devices sdn, sdm {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:36:53.872480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Flush multipath device 3300000003e998b91 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:36:53.904785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:53.954669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:36:54.005306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:36:54.005496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:36:54.006301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:36:54.018495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:36:54.018688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:36:54.032755 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.061525 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:54.065437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.40.100,3260]
May 14 03:36:54.065437 np0000000741 nova-compute[97948]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.40.100,3260] successful.
May 14 03:36:54.065437 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.081317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.094049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.124072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.50.100,3260]
May 14 03:36:54.124072 np0000000741 nova-compute[97948]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-71342ded-3d4b-4074-8ce7-29512e63abfc, portal: 192.168.50.100,3260] successful.
May 14 03:36:54.124072 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.144938 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:54.153664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:54.153664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:54.153664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] <== disconnect_volume: return (318ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:54.153664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:36:54.153980 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Deleting instance files /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff_del
May 14 03:36:54.154475 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Deletion of /opt/stack/data/nova/instances/49558f8d-c20a-4fce-80c6-7959b0ade9ff_del complete
May 14 03:36:54.187025 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:36:54.351323 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:54.376333 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Successfully created port: 76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:36:54.670878 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Took 3.69 seconds to destroy the instance on the hypervisor.
May 14 03:36:54.670878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:54.670878 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:36:54.672744 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:36:54.672865 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:36:54.673251 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:54.689587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:36:54.814587 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:54.854665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d201a5b7-a14f-49dd-a668-4bb5680e615e req-86d78f45-e5ec-4cdc-840d-f99cea5ba9dc service nova] Releasing lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:54.855149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquired lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:54.855333 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:54.883016 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Successfully updated port: 76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:36:55.303269 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:55.303495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:55.303558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:55.303714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:0a:fd:77, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:55.387425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:55.387586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:55.387777 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:36:55.453115 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:55.668687 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-changed-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:55.670861 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Refreshing instance network info cache due to event network-changed-76d984fa-85f7-496b-be37-e00fc37a3d6c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:36:55.672786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] Acquiring lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:36:55.674980 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:55.701097 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:36:55.703667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:36:55.703850 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Creating image(s)
May 14 03:36:55.704310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:55.704499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:55.704948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:55.705535 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:55.710528 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:55.712014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:55.732231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:55.732701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:55.733258 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attaching volume 8cbfb31d-9dbf-4dee-8fff-9f4414202a2a to /dev/vdb
May 14 03:36:55.813898 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:55.821172 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:55.824472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:55.824677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:55.825181 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:55.834137 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:36:55.834890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:55.836226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:36:55.871858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:55.928182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:36:55.928182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:36:55.938468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:36:55.939734 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456'] 
May 14 03:36:55.940241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:36:55.940241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:36:55.940365 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:55.940602 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating existing volume attachment record: 2194e1be-9c50-46ef-9d9b-fe9dc83071d1 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:36:55.952088 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating instance_info_cache with network_info: [{"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:55.957245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.122s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:55.957989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:56.022149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk 1073741824" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:56.023204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:56.023583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:56.078787 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:36:56.143186 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:56.143771 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:36:56.144110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:56.243001 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:56.243376 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Cannot resize image /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:36:56.243775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:36:56.243952 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Ensure instance console log exists: /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:36:56.244231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:56.244537 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:56.244787 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:56.286012 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:56.458483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Releasing lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:56.459059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance network_info: |[{"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:36:56.460890 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Start _get_guest_xml network_info=[{"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:56.465048 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:56.467782 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1136017', uuid='c1690ab4-3a36-4896-a922-ab421f9fc8cb'), owner=OwnerMeta(userid='0cab6a4d716840acaf09bbecaaa536d4', username='tempest-VolumesSnapshotTestJSON-1729950457-project-member', projectid='e4aa2dbc46bc4fd7bb84c997a0a07ac9', projectname='tempest-VolumesSnapshotTestJSON-1729950457'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729816.4673562) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:56.468900 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:56.469278 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:56.470740 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:56.471069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:56.471986 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:56.472341 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:56.472484 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:56.472602 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:56.472737 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:56.472821 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:56.472934 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:56.473122 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:56.473233 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:56.473356 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:56.473473 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:56.473603 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:56.492387 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Updating instance_info_cache with network_info: [{"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:56.497803 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1136017',display_name='tempest-VolumesSnapshotTestJSON-instance-1136017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1136017',id=20,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYw28dTjd64EBoK7mo9VNJGKWI0fhQ9GpOoflIfK4XynsVwnWyy38hHOYL5lsCausN+vPQIqx6zRmHVJzb0vmR2AvgGY14IoQnzGr0j8kqGgXIQWTRxKxmo/oJXurUYfg==',key_name='tempest-keypair-806887781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-di1zo53a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=c1690ab4-3a36-4896-a922-ab421f9fc8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:56.498082 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:56.498612 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:56.499288 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'pci_devices' on Instance uuid c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:56.505474 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:36:56.505819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:36:56.505993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:56.507919 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:56.508333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:36:56.523532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:56.524952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:36:56.525750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:56.526003 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:56.526451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:36:56.526736 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:56.540294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:56.540294 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:56.540918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:36:56.540918 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:56.556700 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a] added
May 14 03:36:56.556700 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:56.556700 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:56.556700 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:56.556700 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:56.556700 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:56.556700 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:56.557439 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a] added
May 14 03:36:56.557439 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:36:56.557439 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:56.557439 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:56.557439 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:36:56.557439 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:36:56.557439 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:56.557686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:56.557998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:36:56.558269 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:56.558482 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:36:56.558718 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:56.558994 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:36:56.897658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3c53ca25-4955-4f79-a7f3-8d5a54dbfcab tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.578s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:57.000055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:57.000360 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Instance network_info: |[{"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:36:57.000691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] Acquired lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:36:57.003967 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Start _get_guest_xml network_info=[{"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:36:57.004476 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Refreshing network info cache for port 76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:36:57.012844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <uuid>c1690ab4-3a36-4896-a922-ab421f9fc8cb</uuid>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <name>instance-00000014</name>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1136017</nova:name>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:56</nova:creationTime>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:user uuid="0cab6a4d716840acaf09bbecaaa536d4">tempest-VolumesSnapshotTestJSON-1729950457-project-member</nova:user>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:project uuid="e4aa2dbc46bc4fd7bb84c997a0a07ac9">tempest-VolumesSnapshotTestJSON-1729950457</nova:project>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         <nova:port uuid="7ea71dcc-3436-473c-936d-1879902e6ccf">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="serial">c1690ab4-3a36-4896-a922-ab421f9fc8cb</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="uuid">c1690ab4-3a36-4896-a922-ab421f9fc8cb</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.config"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:e6:0b:07"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <target dev="tap7ea71dcc-34"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/console.log" append="off"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:57.012844 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Preparing to wait for external event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1136017',display_name='tempest-VolumesSnapshotTestJSON-instance-1136017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1136017',id=20,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYw28dTjd64EBoK7mo9VNJGKWI0fhQ9GpOoflIfK4XynsVwnWyy38hHOYL5lsCausN+vPQIqx6zRmHVJzb0vmR2AvgGY14IoQnzGr0j8kqGgXIQWTRxKxmo/oJXurUYfg==',key_name='tempest-keypair-806887781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-di1zo53a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=c1690ab4-3a36-4896-a922-ab421f9fc8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.019984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76004b27-3b94-5244-9dc5-fff94f16e48a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.024153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:57.033354 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:36:57.034736 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1407162342', uuid='3930430d-5864-4c8c-86ec-ccbbf21f2513'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729817.034301) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:36:57.041794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.042778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ea71dcc-34, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.044686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ea71dcc-34, col_values=(('qos', UUID('6595f45e-1730-4ed9-bfbb-e676a1086673')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.045790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ea71dcc-34, col_values=(('external_ids', {'iface-id': '7ea71dcc-3436-473c-936d-1879902e6ccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:0b:07', 'vm-uuid': 'c1690ab4-3a36-4896-a922-ab421f9fc8cb'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.051250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:57.052659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:36:57.053682 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:36:57.056855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:36:57.058932 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.059570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:36:57.060726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:36:57.061280 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:36:57.062140 np0000000741 nova-compute[97948]: INFO os_vif [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34')
May 14 03:36:57.062708 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:36:57.062963 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:36:57.063333 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:36:57.063546 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:36:57.063731 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:36:57.063794 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:36:57.063943 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:36:57.064032 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:36:57.064191 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:36:57.064351 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:36:57.086589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1407162342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1407162342',id=21,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-nsnko0x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:55Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3930430d-5864-4c8c-86ec-ccbbf21f2513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:36:57.087141 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:57.087427 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:57.088279 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid 3930430d-5864-4c8c-86ec-ccbbf21f2513 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:57.246982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:57.247928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:57.247928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:57.250721 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97948) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 03:36:57.251305 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:57.455970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-82f36dc9-5326-4af8-b00b-7e91fa299251 req-da29eeed-fcf1-4992-a3a0-cff77a1cbeb7 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-deleted-ab798e2b-be0a-492d-9b09-98a7b7225055 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:57.455970 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-82f36dc9-5326-4af8-b00b-7e91fa299251 req-da29eeed-fcf1-4992-a3a0-cff77a1cbeb7 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Neutron deleted interface ab798e2b-be0a-492d-9b09-98a7b7225055; detaching it from the instance and deleting it from the info cache
May 14 03:36:57.455970 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-82f36dc9-5326-4af8-b00b-7e91fa299251 req-da29eeed-fcf1-4992-a3a0-cff77a1cbeb7 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "address": "fa:16:3e:05:b1:f3", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap627a44d5-69", "ovs_interfaceid": "627a44d5-69b7-409d-b04d-d73bde9a4c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:57.523664 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:57.559333 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:36:57.559856 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:57.580992 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:57.580992 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:36:57.584394 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:36:57.584394 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.594518 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] End _get_guest_xml xml=<domain type="qemu">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <uuid>3930430d-5864-4c8c-86ec-ccbbf21f2513</uuid>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <name>instance-00000015</name>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1407162342</nova:name>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:36:57</nova:creationTime>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         <nova:port uuid="76d984fa-85f7-496b-be37-e00fc37a3d6c">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <system>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="serial">3930430d-5864-4c8c-86ec-ccbbf21f2513</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="uuid">3930430d-5864-4c8c-86ec-ccbbf21f2513</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </system>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <os>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </os>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <features>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </features>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   <devices>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.config"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </disk>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:04:aa:6f"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <target dev="tap76d984fa-85"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </interface>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/console.log" append="off"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </serial>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <video>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </video>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </rng>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:   </devices>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]: </domain>
May 14 03:36:57.594518 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:36:57.596443 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Preparing to wait for external event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:36:57.596443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:36:57.596443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:36:57.596443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:57.598989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1407162342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1407162342',id=21,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-nsnko0x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:55Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3930430d-5864-4c8c-86ec-ccbbf21f2513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:36:57.599293 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:36:57.599919 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:36:57.601295 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:36:57.601860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.605887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.605887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.605887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:36:57.607830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.608933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '260c30f4-93df-5620-9317-3dec90fd7cf2', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.611622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.613133 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.624670 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:57.628963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.629230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76d984fa-85, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.629612 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76d984fa-85, col_values=(('qos', UUID('87791d9e-c3c2-4874-bf28-50f58134f476')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.629823 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76d984fa-85, col_values=(('external_ids', {'iface-id': '76d984fa-85f7-496b-be37-e00fc37a3d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:aa:6f', 'vm-uuid': '3930430d-5864-4c8c-86ec-ccbbf21f2513'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:36:57.631531 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.632896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:36:57.634373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.634373 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.634373 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.634373 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.634373 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.634373 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:57.634516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.634516 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.634516 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.634516 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.634516 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.634516 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:57.647596 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:57.648755 np0000000741 nova-compute[97948]: INFO os_vif [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85')
May 14 03:36:57.687281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.40.100,3260]
May 14 03:36:57.687281 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.40.100,3260] successful.
May 14 03:36:57.687281 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.701192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.50.100,3260]
May 14 03:36:57.701192 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.50.100,3260] successful.
May 14 03:36:57.701192 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.704519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.716708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.730852 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:57.730852 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:57.732016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('12', '-', '-', 0) found on session 55 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:57.732349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.740687 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:36:57.740940 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:36:57.741152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:57.741152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:36:57.741789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('13', '-', '-', 0) found on session 56 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:36:57.741895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:36:57.752020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 55 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:57.752020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:57.772657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 56 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:36:57.772657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:36:57.784415 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-deleted-627a44d5-69b7-409d-b04d-d73bde9a4c24 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:57.785730 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Neutron deleted interface 627a44d5-69b7-409d-b04d-d73bde9a4c24; detaching it from the instance and deleting it from the info cache
May 14 03:36:57.785730 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "643b4c43-b59a-4d6c-a242-5832a584a375", "address": "fa:16:3e:52:d1:7e", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap643b4c43-b5", "ovs_interfaceid": "643b4c43-b59a-4d6c-a242-5832a584a375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:57.960587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-82f36dc9-5326-4af8-b00b-7e91fa299251 req-da29eeed-fcf1-4992-a3a0-cff77a1cbeb7 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Detach interface failed, port_id=ab798e2b-be0a-492d-9b09-98a7b7225055, reason: Instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:36:57.970413 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:58.039797 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.113315 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Updated VIF entry in instance network info cache for port 76d984fa-85f7-496b-be37-e00fc37a3d6c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:36:58.113587 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Updating instance_info_cache with network_info: [{"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:58.292743 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Detach interface failed, port_id=627a44d5-69b7-409d-b04d-d73bde9a4c24, reason: Instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:36:58.292938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-deleted-643b4c43-b59a-4d6c-a242-5832a584a375 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:58.293134 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Neutron deleted interface 643b4c43-b59a-4d6c-a242-5832a584a375; detaching it from the instance and deleting it from the info cache
May 14 03:36:58.293469 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [{"id": "7d31361a-05f8-48b4-86b6-a308841519b6", "address": "fa:16:3e:b8:85:58", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d31361a-05", "ovs_interfaceid": "7d31361a-05f8-48b4-86b6-a308841519b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "address": "fa:16:3e:a1:a3:ed", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65705ae3-ab", "ovs_interfaceid": "65705ae3-abe6-46c8-8cd9-00e9ff42b480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7e11d12-da95-4f0b-8c38-d786307636f6", "address": "fa:16:3e:15:20:da", "network": {"id": "7ed260f1-800f-4866-8bc4-e41b7fa7c5a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1546875502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7e11d12-da", "ovs_interfaceid": "d7e11d12-da95-4f0b-8c38-d786307636f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "address": "fa:16:3e:15:ea:a0", "network": {"id": "3aa9f79d-0cf1-423e-b97f-e886081f5255", "bridge": "br-int", "label": "tempest-device-tagging-net2-767264732", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "346418886705456e9de817c5a6473e49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5053041-b6", "ovs_interfaceid": "f5053041-b640-4476-bb1b-eaa08f9cc4ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:58.302949 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:36:58.307667 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.307890 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.330325 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.334582 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.373062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.373615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:58.525913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:36:58.600412 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:58.600412 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:58.600412 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No VIF found with MAC fa:16:3e:e6:0b:07, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:58.600412 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Using config drive
May 14 03:36:58.616678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b9836244-9fff-4f98-ae3d-cf8bbedb19c9 req-ba5b19f7-4109-49aa-8741-f1a5a7c1c85d service nova] Releasing lock "refresh_cache-3930430d-5864-4c8c-86ec-ccbbf21f2513" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:36:58.634668 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999549269999989 future=<Future at 0x79d0b0018440 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:36:58.636609 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance destroyed successfully.
May 14 03:36:58.637149 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:58.801525 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aec27840-b82f-45df-bc5a-18fe75630f7f req-8525edb7-3c2f-4e75-b8d4-c7fb7e29f371 service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Detach interface failed, port_id=643b4c43-b59a-4d6c-a242-5832a584a375, reason: Instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:36:58.806998 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Took 4.13 seconds to deallocate network for instance.
May 14 03:36:59.107320 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:59.141673 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:36:59.141673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:36:59.191662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:59.191662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:36:59.191662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:04:aa:6f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:36:59.191662 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Using config drive
May 14 03:36:59.307018 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Creating config drive at /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.config
May 14 03:36:59.312051 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpppwdjj9g {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:59.366480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpppwdjj9g" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:59.524873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9f35deea-c502-46f7-a2f6-08e8e122079c req-581915c9-15b6-47f8-b8af-dee9512c52cb service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-deleted-f5053041-b640-4476-bb1b-eaa08f9cc4ef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:59.526976 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9f35deea-c502-46f7-a2f6-08e8e122079c req-581915c9-15b6-47f8-b8af-dee9512c52cb service nova] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Received event network-vif-deleted-d7e11d12-da95-4f0b-8c38-d786307636f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:36:59.544496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found WWN 330000000d8869706 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:36:59.544887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:36:59.545068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000d8869706', 'path': '/dev/dm-2', 'multipath_id': '330000000d8869706'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:36:59.545185 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d8869706', 'path': '/dev/dm-2', 'multipath_id': '330000000d8869706'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:36:59.549513 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:36:59.648140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7017c758-b2da-458c-9b4e-fbf54e442696 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.400s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:36:59.704368 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:36:59.845510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:59.881881 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:36:59.895449 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Creating config drive at /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.config
May 14 03:36:59.902480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdwcmt4m {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:36:59.954772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdwcmt4m" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:36:59.994707 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.053327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to attach volume 8cbfb31d-9dbf-4dee-8fff-9f4414202a2a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:37:00.056065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:   <alias name="ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a"/>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:   <serial>8cbfb31d-9dbf-4dee-8fff-9f4414202a2a</serial>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:00.056065 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:37:00.081469 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:00.202557 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.218097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.226066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.253849 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.266613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.497751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:00.498087 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:00.498299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:00.498443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:00.498588 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:00.498755 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9bd98615-a232-43be-b199-a32caa1f158c req-4a655872-dc46-4e8f-a95d-4a1eca13e3ca service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:37:00.575981 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Took 1.77 seconds to detach 3 volumes for instance.
May 14 03:37:00.590027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.592116 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:00.592299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquired lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:00.592350 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:00.593703 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'info_cache' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:00.629949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.673488 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.678934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.755490 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.758496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:00.771149 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:01.101008 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:01.101193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:01.102795 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:01.316693 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729821.3163466, c1690ab4-3a36-4896-a922-ab421f9fc8cb => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:01.317096 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] VM Started (Lifecycle Event)
May 14 03:37:01.605727 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:01.605881 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:01.606028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:01.606142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:01.606261 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Processing event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:37:01.606397 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:01.606498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:01.606598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:01.606729 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:01.606896 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:01.607063 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received unexpected event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with vm_state building and task_state spawning.
May 14 03:37:01.607198 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:01.607349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:01.607499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:01.607632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:01.611852 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Processing event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:37:01.615954 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:01.620153 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:01.620525 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:01.620773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:01.621709 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:01.622650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:01.622820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:01.623002 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:01.623152 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e45fed04-b8cb-4f0c-a25f-682276ff46d2 req-ecab22b8-65d2-4fdc-96af-cece706508ab service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received unexpected event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with vm_state building and task_state spawning.
May 14 03:37:01.623630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:37:01.627875 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance spawned successfully.
May 14 03:37:01.628368 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:37:01.645191 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:37:01.651745 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Instance spawned successfully.
May 14 03:37:01.652189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:37:01.661786 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:01.661786 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:01.826211 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:01.830830 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:02.014074 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:02.016321 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:02.017382 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:02.017583 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No VIF found with MAC fa:16:3e:06:b4:3a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:02.103880 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:02.135264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.135795 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.136236 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.136533 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.136841 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.137273 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.161817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.162005 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.162369 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.162691 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.163050 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.163342 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:02.169085 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:02.322677 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:02.333975 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:37:02.334238 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729822.3340602, c1690ab4-3a36-4896-a922-ab421f9fc8cb => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:02.334371 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] VM Paused (Lifecycle Event)
May 14 03:37:02.607012 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:02.608087 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:02.608293 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:02.608444 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:02.608596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:02.608761 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-f8c85585-18c5-40f3-a30b-ae00c212e8b1 req-b669fc27-fc10-4c21-be7a-e48e4702696a service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:37:02.630528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:02.642724 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Took 9.97 seconds to spawn the instance on the hypervisor.
May 14 03:37:02.642896 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:02.670504 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Took 6.97 seconds to spawn the instance on the hypervisor.
May 14 03:37:02.670698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:02.680009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.579s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:02.745059 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Deleted allocations for instance 49558f8d-c20a-4fce-80c6-7959b0ade9ff
May 14 03:37:02.824742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Releasing lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:02.838774 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:02.840154 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729822.8398972, 3930430d-5864-4c8c-86ec-ccbbf21f2513 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:02.840327 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] VM Started (Lifecycle Event)
May 14 03:37:03.150961 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Took 15.62 seconds to build instance.
May 14 03:37:03.180857 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Took 12.67 seconds to build instance.
May 14 03:37:03.343369 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:03.345739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:03.391961 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:03.581742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-239b9a37-037d-4af6-ad35-a03291feaf9e tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.849s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:03.655551 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.136s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:03.683066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.179s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:03.752908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-17541244-a194-4e22-8563-05834723df87 tempest-TaggedBootDevicesTest_v242-1762907854 tempest-TaggedBootDevicesTest_v242-1762907854-project-member] Lock "49558f8d-c20a-4fce-80c6-7959b0ade9ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.283s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:03.835652 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance destroyed successfully.
May 14 03:37:03.835986 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:03.849447 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729823.848871, 3930430d-5864-4c8c-86ec-ccbbf21f2513 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:03.849447 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] VM Paused (Lifecycle Event)
May 14 03:37:04.106383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:04.106632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:04.337888 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:04.338326 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'resources' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:04.352562 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:04.356336 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729824.3557909, c1690ab4-3a36-4896-a922-ab421f9fc8cb => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:04.356336 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] VM Resumed (Lifecycle Event)
May 14 03:37:04.611753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:37:04.654027 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-changed-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:04.656702 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Refreshing instance network info cache due to event network-changed-7ea71dcc-3436-473c-936d-1879902e6ccf. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:04.656854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] Acquiring lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:04.657476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] Acquired lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:04.657476 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Refreshing network info cache for port 7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:04.840356 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:04.841064 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:37:04.841324 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:04.842022 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:04.842302 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:37:04.843819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:04.844083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3244b2-8c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:04.846251 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:04.846707 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:04.847578 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:04.847738 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acf3549a-c584-463f-9f72-f6703edaab5e) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:04.848776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:04.849238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:04.851348 np0000000741 nova-compute[97948]: INFO os_vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:37:04.852310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:37:04.852653 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:04.852803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:04.853176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:04.853546 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:37:04.853712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:37:04.862680 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:04.862801 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:04.881554 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:04.882170 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '56')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:37:04.882170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '52')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:04.883240 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '53')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:04.884117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0231a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:37:04.884399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:37:04.885253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flush multipath device 330000000e5aa0dba {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:37:04.922217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:04.956555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:04.988103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:37:04.988293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:37:04.989314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:37:05.000954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:37:05.001182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:37:05.012384 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.047136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260]
May 14 03:37:05.047136 np0000000741 nova-compute[97948]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260] successful.
May 14 03:37:05.047136 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.066087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.080081 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.124181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260]
May 14 03:37:05.124181 np0000000741 nova-compute[97948]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260] successful.
May 14 03:37:05.124181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.140700 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.140943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:05.141130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== disconnect_volume: return (288ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:05.141295 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:37:05.146498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start _get_guest_xml network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '7d8e14e9-c419-444d-9a38-73b5f8f65cba', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'serial': 'f45268d7-fef7-4c09-80f4-42bf858fa27d'}, 'boot_index': None, 'attachment_id': '1cb3df95-0535-4780-bd42-c4d69f837257', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:05.148763 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:05.150025 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1243629956', uuid='7d8e14e9-c419-444d-9a38-73b5f8f65cba'), owner=OwnerMeta(userid='03f07c927d2143d2961164592bd62449', username='tempest-AttachVolumeTestJSON-1091031368-project-member', projectid='3492928cd5f64475bf5572822120dbbc', projectname='tempest-AttachVolumeTestJSON-1091031368'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729825.1496189) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:05.151074 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:05.151439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:05.152095 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:05.152288 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:05.154312 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:05.154612 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:05.154782 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:05.154882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:05.155024 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:05.155115 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:05.155211 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:05.155374 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:05.155480 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:05.155596 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:05.155732 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:05.155846 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:05.156012 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:05.167930 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:05.184546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:05.185167 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:05.188757 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:37:05.188888 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Claim successful on node np0000000741
May 14 03:37:05.366129 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729825.365748, 3930430d-5864-4c8c-86ec-ccbbf21f2513 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:05.366575 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] VM Resumed (Lifecycle Event)
May 14 03:37:05.629053 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:05.658673 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:05.677717 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:05.679843 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:05.778752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:05.782378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:05.782378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:05.783170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:05.793051 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:05.793748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:05.794018 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:05.796285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:05.796764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:05.812609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:05.813795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:05.814162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:05.814342 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:05.815182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:05.815427 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:05.829819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:05.829819 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.836217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:05.836217 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d] added
May 14 03:37:05.845312 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:05.845312 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:05.845312 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:05.849957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d] added
May 14 03:37:05.849957 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:05.849957 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:05.849957 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:05.849957 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:05.849957 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:05.849957 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:05.850141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:05.850243 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:05.850366 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:05.869121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:05.871677 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: image_snapshot, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:05.906561 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updated VIF entry in instance network info cache for port 7ea71dcc-3436-473c-936d-1879902e6ccf. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:37:05.907701 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating instance_info_cache with network_info: [{"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:06.138578 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] instance snapshotting
May 14 03:37:06.195902 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:06.246792 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Beginning live snapshot process
May 14 03:37:06.375374 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] During sync_power_state the instance has a pending task (image_snapshot). Skip.
May 14 03:37:06.410026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-22af94fc-4a25-4b97-80e1-421f81f9b453 req-f3efecea-92c5-4421-8d5f-27ca545c2284 service nova] Releasing lock "refresh_cache-c1690ab4-3a36-4896-a922-ab421f9fc8cb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:06.513131 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004186959999969986 future=<Future at 0x79d0b0214680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:06.513574 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778729811.5125918, 49558f8d-c20a-4fce-80c6-7959b0ade9ff => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:06.513735 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:06.513934 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] VM Stopped (Lifecycle Event)
May 14 03:37:06.514945 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.116847967000012 future=<Future at 0x79d0b0018440 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:06.515033 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.116734227000052 future=<Future at 0x79d0b0018440 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:06.775884 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:06.776834 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:06.845746 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:06.851228 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:06.859268 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:06.859268 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:06.868208 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:06.868208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.877684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.887493 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.896000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.896000 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.896000 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.896000 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.896000 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.896000 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:06.896319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.896319 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.896319 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.896319 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.896319 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.896319 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:06.903779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.903779 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.903779 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.903779 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.903779 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.903779 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:06.904188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.904188 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.904188 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.904188 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.904188 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.904188 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:06.940507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260]
May 14 03:37:06.940507 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260] successful.
May 14 03:37:06.940507 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.948104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260]
May 14 03:37:06.948104 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260] successful.
May 14 03:37:06.948104 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.955215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.965247 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.974765 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.975291 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:06.975291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:06.975583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:06.976344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('7', '-', '-', 0) found on session 57 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:06.976467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.983227 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87441c6c-21c9-4dda-a485-e93f3810b852 (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:06.983437 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:06.983572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:06.983765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:06.984490 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('8', '-', '-', 0) found on session 58 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:06.984596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:06.993089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 57 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:06.993249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:07.004876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 58 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:07.005399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:07.017717 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 49558f8d-c20a-4fce-80c6-7959b0ade9ff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:07.282205 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:07.762340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:07.794730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.609s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:07.795568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:37:07.814958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:37:07.866419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:07.867063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:07.953527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json -f qcow2" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:07.954226 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:07.957004 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:07.957327 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:08.070609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:08.071299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3.delta 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:08.134145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3.delta 1073741824" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:08.134145 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 03:37:08.216144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:08.216439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:08.305194 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:37:08.307711 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:37:08.307711 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:08.307711 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:08.385920 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51351b66a80d4223ab08bdc7a8aa2e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e6a6a9723c40a3bab2a058ab67df9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:37:08.388479 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:37:08.389856 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 03:37:08.394654 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:08.436338 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:37:08.436625 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3.delta /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:08.547659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3.delta /opt/stack/data/nova/instances/snapshots/tmp7wems3wq/bda8bd73cbe545d6828820e0987a24e3" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:08.547892 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Snapshot extracted, beginning image upload
May 14 03:37:08.720668 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Detaching volume 8cbfb31d-9dbf-4dee-8fff-9f4414202a2a
May 14 03:37:08.769558 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to driver detach volume 8cbfb31d-9dbf-4dee-8fff-9f4414202a2a from mountpoint /dev/vdb
May 14 03:37:08.779260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:08.783591 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:08.783771 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Attempting to detach device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:37:08.784110 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <alias name="ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a"/>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <serial>8cbfb31d-9dbf-4dee-8fff-9f4414202a2a</serial>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:08.784110 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:08.798592 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config.
May 14 03:37:08.798771 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] (1/8): Attempting to detach device vdb with device alias ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:37:08.799152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <alias name="ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a"/>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <serial>8cbfb31d-9dbf-4dee-8fff-9f4414202a2a</serial>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:08.799152 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:08.808655 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:37:08.833549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found WWN 330000000e5aa0dba for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:08.834795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:08.834795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000e5aa0dba', 'path': '/dev/dm-0', 'multipath_id': '330000000e5aa0dba'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:08.834795 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5aa0dba', 'path': '/dev/dm-0', 'multipath_id': '330000000e5aa0dba'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:09.312552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:37:09.352602 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:09.353002 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:09.353668 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:09.354427 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:09.460065 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Successfully created port: 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:37:09.480776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729829.4801967, 3defa392-75f0-4f24-b15d-d14ec40200cf => ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:37:09.482019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a for instance 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:37:09.484620 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config.
May 14 03:37:09.485594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:37:09.486024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:09.486187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:09.486632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:09.487014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:37:09.487185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:09.513855 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:09.514224 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:09.514224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '58')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:37:09.514911 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '55')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:09.515205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a', '56')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:09.516538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b043a700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'): ({'sdh'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:37:09.516538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Removing multipathed devices sdh, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:37:09.516538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flush multipath device 330000000d8869706 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:37:09.548696 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:09.584967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:09.644215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:37:09.644379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:37:09.646284 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:37:09.658790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:37:09.659088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:37:09.673149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.706086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.40.100,3260]
May 14 03:37:09.706086 np0000000741 nova-compute[97948]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.40.100,3260] successful.
May 14 03:37:09.706086 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.721402 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.733059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.771932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.50.100,3260]
May 14 03:37:09.771932 np0000000741 nova-compute[97948]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-8cbfb31d-9dbf-4dee-8fff-9f4414202a2a, portal: 192.168.50.100,3260] successful.
May 14 03:37:09.771932 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.790353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:09.790724 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:09.790906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== disconnect_volume: return (304ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:09.791084 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:37:09.851911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:09.856629 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:09.858884 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <uuid>7d8e14e9-c419-444d-9a38-73b5f8f65cba</uuid>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <name>instance-00000011</name>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeTestJSON-server-1243629956</nova:name>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:05</nova:creationTime>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:user uuid="03f07c927d2143d2961164592bd62449">tempest-AttachVolumeTestJSON-1091031368-project-member</nova:user>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:project uuid="3492928cd5f64475bf5572822120dbbc">tempest-AttachVolumeTestJSON-1091031368</nova:project>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         <nova:port uuid="1b3244b2-8c49-400e-a1bf-35efd21b792a">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="serial">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="uuid">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <alias name="ua-f45268d7-fef7-4c09-80f4-42bf858fa27d"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <serial>f45268d7-fef7-4c09-80f4-42bf858fa27d</serial>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0a:fd:77"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <target dev="tap1b3244b2-8c"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/console.log" append="off"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:09.858884 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:09.858884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:09.983666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:09.986242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.084818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.087785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:37:10.090540 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:10.148817 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Successfully updated port: 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:37:10.199384 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-changed-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:10.202988 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Refreshing instance network info cache due to event network-changed-30fbba53-5fb6-4c07-8fc5-9744ea6b8967. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:10.203317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:10.203478 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:10.203529 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Refreshing network info cache for port 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:10.331709 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:37:10.331709 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:37:10.331709 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Creating image(s)
May 14 03:37:10.336488 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:10.336488 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:10.336488 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:10.336488 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:10.339513 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:10.341257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.377621 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:10.459477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.118s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.459925 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:10.460488 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:10.462524 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:10.463210 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:10.463499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.561854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.563544 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.600591 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:10.601216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.631755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk 1073741824" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.632479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:10.633042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.657822 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:10.708983 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:10.715553 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.715965 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:37:10.716226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.729311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.731016 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:37:10.731482 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:10.809743 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.810240 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Cannot resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:37:10.810501 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'migration_context' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:10.815504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:10.815836 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Cannot resize image /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:37:10.816263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:37:10.816488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Ensure instance console log exists: /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:37:10.819836 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:10.823457 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:10.823777 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:10.828988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:11.035393 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:11.314120 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:11.315264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:37:11.315455 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:11.316202 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:11.316481 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:37:11.318885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.319219 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:11.319556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:37:11.320467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.320651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2464d8f-4f72-5b72-8b00-327620658182', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:11.323236 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.324089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:11.338209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.338441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3244b2-8c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:11.338930 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b3244b2-8c, col_values=(('qos', UUID('13c55514-aedf-41b6-b949-47a7ad5fe35a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:11.339145 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b3244b2-8c, col_values=(('external_ids', {'iface-id': '1b3244b2-8c49-400e-a1bf-35efd21b792a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fd:77', 'vm-uuid': '7d8e14e9-c419-444d-9a38-73b5f8f65cba'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:11.340309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.344671 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:11.347201 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.348876 np0000000741 nova-compute[97948]: INFO os_vif [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:37:11.369317 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Snapshot image upload complete
May 14 03:37:11.369551 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d12b6c79-77ac-42d0-bafe-80e7d06087bd tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Took 5.22 seconds to snapshot the instance on the hypervisor.
May 14 03:37:11.396310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5dd6b28d-f8d6-4276-b801-612a286c3e97 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.180s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:11.538906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c324e7de-b9c4-4470-ad10-7f3ada95295c req-f55f28c0-4697-44be-ab0e-ba56ea0cd7d9 service nova] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:11.539392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:11.539532 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:11.815008 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.874683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.898508 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:11.906393 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:12.012958 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:12.122788 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:12.255831 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:12.255831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:12.255831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:12.255831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:12.255831 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:12.256625 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3c358e6d-fad5-4b45-9cbd-47fa6a608632 req-ecf84574-2182-4911-ae9d-6eb1b738b302 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:37:12.261997 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:12.272615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:12.301843 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:12.347131 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:12.556453 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:13.004874 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:13.005357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:13.032099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:13.032355 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 7d8e14e9-c419-444d-9a38-73b5f8f65cba due to new event <LifecycleEvent: 1778729833.0319374, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:37:13.032578 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729833.0319374, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:13.032771 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Resumed (Lifecycle Event)
May 14 03:37:13.044394 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance rebooted successfully.
May 14 03:37:13.058782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:13.059798 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance network_info: |[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:37:13.064356 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start _get_guest_xml network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:13.069180 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:13.070588 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1378982848', uuid='571defbc-9543-4887-939b-0ad9b4067a4f'), owner=OwnerMeta(userid='51351b66a80d4223ab08bdc7a8aa2e57', username='tempest-ServerActionsTestOtherB-1843754337-project-member', projectid='97e6a6a9723c40a3bab2a058ab67df9f', projectname='tempest-ServerActionsTestOtherB-1843754337'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729833.070191) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:13.072377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:13.072790 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:13.075130 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:13.075832 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:13.078551 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:13.079056 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:13.079264 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:13.079387 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:13.079539 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:13.079663 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:13.081291 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:13.081291 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:13.081427 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:13.081569 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:13.082679 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:13.082679 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:13.099276 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:13.099484 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:13.100051 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:13.100764 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'pci_devices' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:13.406505 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.509307 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:13.537790 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:13.541426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:13.603840 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <uuid>571defbc-9543-4887-939b-0ad9b4067a4f</uuid>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <name>instance-00000016</name>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherB-server-1378982848</nova:name>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:13</nova:creationTime>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:user uuid="51351b66a80d4223ab08bdc7a8aa2e57">tempest-ServerActionsTestOtherB-1843754337-project-member</nova:user>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:project uuid="97e6a6a9723c40a3bab2a058ab67df9f">tempest-ServerActionsTestOtherB-1843754337</nova:project>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         <nova:port uuid="30fbba53-5fb6-4c07-8fc5-9744ea6b8967">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="serial">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="uuid">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:fd:f9:20"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <target dev="tap30fbba53-5f"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/console.log" append="off"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:13.603840 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Preparing to wait for external event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:37:13.607280 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:13.608187 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:13.608883 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:37:13.609761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.609858 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:13.611042 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:37:13.612480 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.612765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6735a810-25f4-516a-9033-1e52f702279c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:13.613991 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.616284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:13.616284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.619129 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.619400 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fbba53-5f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:13.620211 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30fbba53-5f, col_values=(('qos', UUID('367ef13c-cdd9-4247-b8f0-f39d54b74de3')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:13.620873 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30fbba53-5f, col_values=(('external_ids', {'iface-id': '30fbba53-5fb6-4c07-8fc5-9744ea6b8967', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:f9:20', 'vm-uuid': '571defbc-9543-4887-939b-0ad9b4067a4f'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:13.622674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.625020 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:13.632187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:13.633600 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0017025789998115215 future=<Future at 0x79d0b0018440 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:13.633820 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:13.634374 np0000000741 nova-compute[97948]: INFO os_vif [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:37:13.825561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:13.826029 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:14.045037 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:37:14.045532 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729834.04525, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:14.045595 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Started (Lifecycle Event)
May 14 03:37:14.331975 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:37:14.347571 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:14.348135 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:14.348313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:14.348440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:14.348574 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:14.348724 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-614c6668-a837-45cc-b991-22b2f0d81981 req-9d042911-03b6-456b-a7e5-f63c47ed978e service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:37:14.460834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:14.516320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:14.548351 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:14.550011 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:14.554752 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:14.554959 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:14.555018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:14.555142 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:0a:fd:77, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:14.555509 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9da62bc1-144b-49e2-8cdf-be7d8eb9a878 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:14.922097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:14.922663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:14.930266 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:37:14.930551 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Claim successful on node np0000000741
May 14 03:37:15.054075 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:37:15.159162 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:15.159333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:15.159333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No VIF found with MAC fa:16:3e:fd:f9:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:15.159808 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Using config drive
May 14 03:37:15.605184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:15.605502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:15.605783 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attaching volume 96cd03ec-a008-4c8e-8c2f-821d704e2fe6 to /dev/vdb
May 14 03:37:15.658490 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:15.669157 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:15.675799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:37:15.699012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:15.754406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:37:15.754731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:37:15.765686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:37:15.765808 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456', 'fe80::fc16:3eff:fee6:b07', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe04:aa6f', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e'] 
May 14 03:37:15.767720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:37:15.767720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:37:15.767720 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:15.767720 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating existing volume attachment record: 30ce1ef0-128d-43dc-ad4d-c16eff1782ee {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:37:15.861282 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Creating config drive at /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config
May 14 03:37:15.865792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy97o6duj {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:15.919377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy97o6duj" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:16.342753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:16.343248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:16.343362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:16.398192 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.438075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.511585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:16.511686 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:16.530139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.657596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09505f43-308d-4973-9948-7e4b676ce484 req-d42ee075-b395-4525-9362-c8dcafc005be service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:16.658607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09505f43-308d-4973-9948-7e4b676ce484 req-d42ee075-b395-4525-9362-c8dcafc005be service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:16.658607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09505f43-308d-4973-9948-7e4b676ce484 req-d42ee075-b395-4525-9362-c8dcafc005be service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:16.658607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09505f43-308d-4973-9948-7e4b676ce484 req-d42ee075-b395-4525-9362-c8dcafc005be service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:16.658776 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09505f43-308d-4973-9948-7e4b676ce484 req-d42ee075-b395-4525-9362-c8dcafc005be service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Processing event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:37:16.781443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.785217 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.789402 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.816618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:16.827686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:17.019513 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:17.527971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:17.528549 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:37:17.533571 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729837.5331705, 571defbc-9543-4887-939b-0ad9b4067a4f => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:17.533811 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Started (Lifecycle Event)
May 14 03:37:17.536021 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:17.544366 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:37:17.546438 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance spawned successfully.
May 14 03:37:17.546558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:37:17.783360 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:17.784832 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:17.785082 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:18.037077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:37:18.037927 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:18.038442 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:37:18.038908 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:18.039219 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:18.043616 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:18.053821 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.053960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.054272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.054751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.055216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.055598 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:18.131139 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe2ffc6cce044f7ad75df57827bc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6177683ef84349e5a26042f334b26ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:37:18.290069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:18.290300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:18.290515 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:18.290704 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:37:18.301241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.957s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:18.301241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:18.320769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:18.321761 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:18.323337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:18.323536 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:18.324413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:18.324672 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:18.340493 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:18.340493 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:18.345841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:18.345841 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6] added
May 14 03:37:18.355589 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:18.355589 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:18.355589 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:18.364431 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6] added
May 14 03:37:18.364431 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:18.364431 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:18.364431 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:18.364431 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:18.364431 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:18.364431 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:18.364955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:18.364955 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:18.364955 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:18.407686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:18.538606 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:37:18.545207 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:37:18.545207 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729838.544843, 571defbc-9543-4887-939b-0ad9b4067a4f => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:18.545992 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Paused (Lifecycle Event)
May 14 03:37:18.560787 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Took 8.24 seconds to spawn the instance on the hypervisor.
May 14 03:37:18.560937 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:18.622234 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:18.758319 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:18.758485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:18.758629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:18.758776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:18.758897 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:18.759021 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-76a580c5-7bdd-47ec-bf14-272e381d064a req-a121e2a6-d5a6-42f2-a993-8f2a29104124 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state active and task_state None.
May 14 03:37:18.823798 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Successfully created port: 823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:37:19.041982 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:37:19.050877 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:19.054847 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729839.0542028, 571defbc-9543-4887-939b-0ad9b4067a4f => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:19.054847 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Resumed (Lifecycle Event)
May 14 03:37:19.075133 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Took 13.95 seconds to build instance.
May 14 03:37:19.336943 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:19.357173 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:19.368728 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:19.378533 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:19.378533 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:19.389476 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:19.389476 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.398549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.409812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.427953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.427953 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.427953 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.427953 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.427953 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.427953 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:19.428492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.428492 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.428492 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.428492 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.428492 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.428492 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:19.438353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.438353 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.438353 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.438353 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.438353 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.438353 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:19.438706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.438706 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.438706 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.438706 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.438706 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.438706 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:19.472532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:19.473183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:19.496256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.40.100,3260]
May 14 03:37:19.496256 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.40.100,3260] successful.
May 14 03:37:19.496256 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.498365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.50.100,3260]
May 14 03:37:19.498365 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.50.100,3260] successful.
May 14 03:37:19.498365 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.515695 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.517586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.545513 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.547496 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:19.547496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:19.548524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('13', '-', '-', 0) found on session 61 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:19.548878 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:19.553747 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Booting with volume-backed-image 6612e57f-dc02-432a-8f21-51e588d0e5b8 at /dev/vda
May 14 03:37:19.569159 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.571248 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:19.571770 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:19.579552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.249s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:19.579552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:19.579552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:19.590254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20c9dea-7b7c-4983-8f78-34ffaab4fd4c tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.480s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:19.597252 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:19.603709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 61 and hctl ['13', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:19.603709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:19.610500 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] HCTL ('12', '-', '-', 0) found on session 60 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:19.616713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:19.618519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:19.669048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Searching for a device in session 60 and hctl ['12', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:19.670104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:19.677235 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:19.725683 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Successfully updated port: 823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:37:19.760173 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:19.760700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:19.894746 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-changed-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:19.894985 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Refreshing instance network info cache due to event network-changed-823bc695-29a1-4bb8-bf76-ce875e310182. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:19.895269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] Acquiring lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:19.895392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] Acquired lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:19.895567 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Refreshing network info cache for port 823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:19.944338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:19.946681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.035719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.037157 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.171540 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.177665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:37:20.181479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.242374 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:20.314477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.319020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.333493 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:37:20.402447 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:20.474290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.474290 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:37:20.480749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.640287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.643199 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.742504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.746101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.775165 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:20.867264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.867825 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:20.989904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:20.997983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:21.121925 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:21.122830 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:21.221112 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:21.224699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:21.230805 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:21.230805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:21.284874 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:21.286310 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12553MB free_disk=73.34860229492188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:37:21.287738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:21.288201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:21.355519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found WWN 3300000005a150caf for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:21.355977 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.055s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:21.356303 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== connect_volume: return (5012ms) {'type': 'block', 'scsi_wwn': '3300000005a150caf', 'path': '/dev/dm-2', 'multipath_id': '3300000005a150caf'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:21.356549 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005a150caf', 'path': '/dev/dm-2', 'multipath_id': '3300000005a150caf'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:21.365577 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:21.724718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c57592a2-91c3-400c-97e2-952699c47c9a req-af94f2c4-1801-4397-a645-4d5eb99c2161 service nova] Releasing lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:21.724718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:21.725373 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:21.870174 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to attach volume 96cd03ec-a008-4c8e-8c2f-821d704e2fe6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:37:21.874665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:   <alias name="ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6"/>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:   <serial>96cd03ec-a008-4c8e-8c2f-821d704e2fe6</serial>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:21.874665 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:37:22.014564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-changed-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:22.014831 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Refreshing instance network info cache due to event network-changed-30fbba53-5fb6-4c07-8fc5-9744ea6b8967. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:22.015250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:22.015250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:22.015346 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Refreshing network info cache for port 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:22.333699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:22.427984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:22.455516 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3defa392-75f0-4f24-b15d-d14ec40200cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.455803 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 42a1f2e8-804b-4703-ad8d-4ecf57fe737a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456001 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456406 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f06ca3e4-a0f1-48d5-99a3-16d877adef99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456406 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456406 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c1690ab4-3a36-4896-a922-ab421f9fc8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456597 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3930430d-5864-4c8c-86ec-ccbbf21f2513 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456597 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 571defbc-9543-4887-939b-0ad9b4067a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456715 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3273e916-e64e-40be-acfc-17ecdfb15f04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:37:22.456920 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:37:22.457287 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:37:21 up 29 min,  2 users,  load average: 9.25, 6.54, 3.22\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_817445e1e7da4d278a96c6cdd6c14c0e': '1', 'io_workload': '1', 'num_proj_6177683ef84349e5a26042f334b26ddd': '4', 'num_proj_3492928cd5f64475bf5572822120dbbc': '1', 'num_task_image_snapshot_pending': '1', 'num_proj_203276d61c614abaab90c3d9d6e99e0e': '1', 'num_proj_e4aa2dbc46bc4fd7bb84c997a0a07ac9': '1', 'num_proj_97e6a6a9723c40a3bab2a058ab67df9f': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:37:22.496458 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:22.519221 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:22.751389 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:22.847606 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] instance snapshotting
May 14 03:37:23.001336 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:23.055609 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Beginning live snapshot process
May 14 03:37:23.087879 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:23.226304 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:23.226550 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:23.299468 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updated VIF entry in instance network info cache for port 30fbba53-5fb6-4c07-8fc5-9744ea6b8967. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:37:23.299957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:23.408187 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:23.412441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:23.426119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:37:23.458313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:23.505699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:23.506998 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance network_info: |[{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:37:23.526800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:37:23.529674 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:37:23.542741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:37:23.553384 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456', 'fe80::fc16:3eff:fee6:b07', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe04:aa6f', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fefd:f920', 'fe80::6ca6:c7ff:fe5a:222d'] 
May 14 03:37:23.554043 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:37:23.554252 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:37:23.555301 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:23.560226 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating existing volume attachment record: 1b6eb5c1-e7c6-4469-913c-4c204893cb7a {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:37:23.580921 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:23.584008 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:23.584228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:23.584476 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] No VIF found with MAC fa:16:3e:06:b4:3a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:23.624526 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:23.733983 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:23.802843 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00f5b908-11b1-4b3e-b87e-8a735cd07fcb req-8287f1ee-b673-462d-8f81-e2602d7386ac service nova] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:24.244834 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:37:24.244834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.956s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:24.246412 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:37:24.586458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:24.697102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:24.702684 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:24.802613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json -f qcow2" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:24.806081 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:24.809139 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:24.809487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:24.898751 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:24.902666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362.delta 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:24.949657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362.delta 1073741824" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:24.950918 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 03:37:25.175336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d46bec6b-6a7e-4a2c-9e46-5c97500bd1d3 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.570s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:25.246860 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:25.246860 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:25.246860 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:25.246860 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:25.247141 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:37:25.247141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:37:25.247667 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.53 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:37:25.248151 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:37:25.744667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:37:25.745864 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:37:25.746161 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Creating image(s)
May 14 03:37:25.746448 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:37:25.746562 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Ensure instance console log exists: /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:37:25.747056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:25.747470 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:25.747790 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:25.748361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start _get_guest_xml network_info=[{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3273e916-e64e-40be-acfc-17ecdfb15f04', 'attached_at': '', 'detached_at': '', 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'serial': '5fc43301-192c-4b7f-a57b-89793b9f9364'}, 'boot_index': 0, 'attachment_id': '1b6eb5c1-e7c6-4469-913c-4c204893cb7a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:25.750316 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:37:25.752356 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 03:37:25.753309 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:25.754501 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484', uuid='3273e916-e64e-40be-acfc-17ecdfb15f04'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729845.7541492) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:25.755650 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:25.756059 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:25.757049 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:25.757268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:25.758352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:25.758765 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:25.758983 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:25.759089 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:25.759218 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:25.759291 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:25.759383 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:25.759552 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:25.759647 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:25.759778 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:25.759899 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:25.760037 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:25.771413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:25.771860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:25.772072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:25.772627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:25.772899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:25.786073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:25.786679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:25.787171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:25.787627 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:25.788887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:25.789746 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:25.803179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:25.803179 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:25.804930 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:37:25.805367 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362.delta /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:25.818962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364] added
May 14 03:37:25.818962 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:25.818962 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:25.818962 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:25.818962 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:25.818962 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:25.818962 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:25.819840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:25.819840 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:25.820184 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:25.820879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:25.820879 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:25.837492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364] added
May 14 03:37:25.837492 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:25.837492 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:25.837492 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:25.837492 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:25.837492 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:25.837492 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:25.837818 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:25.838135 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.049(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:25.838413 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:26.127842 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:26.127999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:26.208736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362.delta /opt/stack/data/nova/instances/snapshots/tmpdfm09q9f/23fac251915d462886066f60a3af4362" returned: 0 in 0.403s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:26.212805 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Snapshot extracted, beginning image upload
May 14 03:37:26.631697 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:37:26.821418 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:26.836041 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:26.836041 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.840952 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:26.855167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:26.864368 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:26.864368 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.877744 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.878155 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:26.878798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.893773 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.894051 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:26.919466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.40.100,3260]
May 14 03:37:26.919466 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.40.100,3260] successful.
May 14 03:37:26.919466 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.934503 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.944797 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.50.100,3260]
May 14 03:37:26.944797 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.50.100,3260] successful.
May 14 03:37:26.944797 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.953389 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.953806 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:26.954046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:26.954411 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:26.955527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('14', '-', '-', 0) found on session 62 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:26.955708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:26.962066 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:26.976875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 62 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:26.976875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:26.986147 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('15', '-', '-', 0) found on session 63 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:26.986147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:27.005110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 63 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:27.005588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:27.222829 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:27.224684 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:27.226184 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:37:27.226356 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Claim successful on node np0000000741
May 14 03:37:27.789721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:37:28.418795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:28.629992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:28.812813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Found WWN 330000000f9900e53 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:28.813250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:28.813563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000f9900e53', 'path': '/dev/dm-3', 'multipath_id': '330000000f9900e53'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:28.813797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f9900e53', 'path': '/dev/dm-3', 'multipath_id': '330000000f9900e53'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:28.987503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:28.987801 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:29.197772 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Snapshot image upload complete
May 14 03:37:29.198093 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8c72e8d7-e18f-4716-8268-f9e3a6549856 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Took 6.35 seconds to snapshot the instance on the hypervisor.
May 14 03:37:29.325063 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-453469484',id=23,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-wm7j1rtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:19Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3273e916-e64e-40be-acfc-17ecdfb15f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:29.325342 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:29.326093 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:29.328104 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:29.492842 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:29.794956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:29.794956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:29.831502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <uuid>3273e916-e64e-40be-acfc-17ecdfb15f04</uuid>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <name>instance-00000017</name>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-453469484</nova:name>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:25</nova:creationTime>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         <nova:port uuid="823bc695-29a1-4bb8-bf76-ce875e310182">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="serial">3273e916-e64e-40be-acfc-17ecdfb15f04</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="uuid">3273e916-e64e-40be-acfc-17ecdfb15f04</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <alias name="ua-5fc43301-192c-4b7f-a57b-89793b9f9364"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-3"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <serial>5fc43301-192c-4b7f-a57b-89793b9f9364</serial>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:20:69:7e"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <target dev="tap823bc695-29"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/console.log" append="off"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:29.831502 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Preparing to wait for external event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-453469484',id=23,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-wm7j1rtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:19Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3273e916-e64e-40be-acfc-17ecdfb15f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:29.835218 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:29.835744 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:37:29.836733 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.837022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:29.837359 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:37:29.842392 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.843552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ff47c93-70db-57ae-bc5e-505e25326435', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:29.844887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.845942 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:29.852456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.852766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap823bc695-29, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:29.853261 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap823bc695-29, col_values=(('qos', UUID('34837559-8e3f-4fae-b88a-adbceacf8625')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:29.853562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap823bc695-29, col_values=(('external_ids', {'iface-id': '823bc695-29a1-4bb8-bf76-ce875e310182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:69:7e', 'vm-uuid': '3273e916-e64e-40be-acfc-17ecdfb15f04'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:29.856332 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.859606 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:29.865345 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:29.867860 np0000000741 nova-compute[97948]: INFO os_vif [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29')
May 14 03:37:30.002830 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.780s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:30.003188 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:37:30.300687 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Detaching volume 96cd03ec-a008-4c8e-8c2f-821d704e2fe6
May 14 03:37:30.344235 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Attempting to driver detach volume 96cd03ec-a008-4c8e-8c2f-821d704e2fe6 from mountpoint /dev/vdb
May 14 03:37:30.346984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:30.352865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Found disk vdb by alias ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:30.352865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Attempting to detach device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:37:30.352865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <alias name="ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6"/>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <serial>96cd03ec-a008-4c8e-8c2f-821d704e2fe6</serial>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:30.352865 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:30.360698 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the persistent domain config.
May 14 03:37:30.361229 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] (1/8): Attempting to detach device vdb with device alias ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:37:30.364524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <alias name="ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6"/>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <serial>96cd03ec-a008-4c8e-8c2f-821d704e2fe6</serial>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:30.364524 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:30.509988 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:37:30.511093 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:37:30.511537 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:30.512386 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:30.609113 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71a50ef37e66489cbf8dc1dde0950769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a8404c7d33468cab5b1fb42b63d221', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:37:30.725556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:30.726698 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:31.003577 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729851.0030546, 3defa392-75f0-4f24-b15d-d14ec40200cf => ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:37:31.005658 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 for instance 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:37:31.006896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:31.014328 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully detached device vdb from instance 3defa392-75f0-4f24-b15d-d14ec40200cf from the live domain config.
May 14 03:37:31.014929 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:37:31.018195 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:37:31.019336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:31.019534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:31.021017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:31.021613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:37:31.021862 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:31.056248 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:31.056860 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:31.056860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4dd1fd19-d732-4e14-a97c-50c6d6183076', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '63')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:37:31.057483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', '60')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:31.058451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6', '61')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:31.059709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b043bce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:37:31.059979 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Removing multipathed devices sdh, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:37:31.060199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Flush multipath device 3300000005a150caf {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:37:31.095100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:31.147578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:31.200448 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:37:31.200770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:37:31.202622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:37:31.222508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:37:31.223300 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:37:31.235138 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'flavor' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:31.241423 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.268799 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Successfully created port: d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:37:31.284278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.40.100,3260]
May 14 03:37:31.284278 np0000000741 nova-compute[97948]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.40.100,3260] successful.
May 14 03:37:31.284278 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.306981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.317617 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.353444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.50.100,3260]
May 14 03:37:31.353444 np0000000741 nova-compute[97948]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-96cd03ec-a008-4c8e-8c2f-821d704e2fe6, portal: 192.168.50.100,3260] successful.
May 14 03:37:31.353444 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.374732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:31.374970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:31.375093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] <== disconnect_volume: return (355ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:31.375222 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:37:31.402368 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:31.402368 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:31.402503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:20:69:7e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:31.402974 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Using config drive
May 14 03:37:31.522083 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:37:31.832170 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Successfully updated port: d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:37:31.881293 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:31.881788 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing instance network info cache due to event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:31.881977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] Acquiring lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:31.882115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] Acquired lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:31.882340 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing network info cache for port d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:31.910317 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:31.930421 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'flavor' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:32.034546 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Creating config drive at /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config
May 14 03:37:32.038046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6bhjspwv {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:32.086449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6bhjspwv" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:32.259156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.533s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:32.334291 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:32.385665 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:32.470747 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:32.537076 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:37:32.538160 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:37:32.538418 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Creating image(s)
May 14 03:37:32.542122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:32.542356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:32.544224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:32.544769 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:32.553303 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:32.559846 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:32.582240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:32.616040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:32.695232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.134s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:32.695232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:32.695852 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:32.697039 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:32.700735 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:32.700781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:32.724266 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:32.733737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:32.777083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:32.779063 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:32.812198 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:32.812570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:32.877769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk 1073741824" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:32.880039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:32.880039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:32.901520 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1cbee024-cae7-421b-9c42-212fe0673eda req-64406139-07e4-47a5-959d-e84fffc4de11 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:32.902571 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1cbee024-cae7-421b-9c42-212fe0673eda req-64406139-07e4-47a5-959d-e84fffc4de11 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:32.909105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1cbee024-cae7-421b-9c42-212fe0673eda req-64406139-07e4-47a5-959d-e84fffc4de11 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:32.909662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1cbee024-cae7-421b-9c42-212fe0673eda req-64406139-07e4-47a5-959d-e84fffc4de11 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:32.909662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1cbee024-cae7-421b-9c42-212fe0673eda req-64406139-07e4-47a5-959d-e84fffc4de11 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Processing event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:37:32.941623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d09f7730-e1b5-499c-990f-825f9f46f402 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.148s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:32.985103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:32.985404 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:37:32.986733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:33.078517 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Cannot resize image /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Ensure instance console log exists: /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:33.080695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:33.229015 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5267f646-0199-48da-a57e-0a4e3d07341b req-b50577d6-8665-40ec-9018-3f4bec3d6613 service nova] Releasing lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:33.230851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:33.230851 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:33.411262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:33.411444 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:33.411647 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attaching volume 4ee06340-b4e7-4638-8043-b0bbc4dbe912 to /dev/vdb
May 14 03:37:33.419232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:33.466252 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:33.477885 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:37:33.502045 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:33.541020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:37:33.541541 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:37:33.546411 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:33.547631 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729853.546623, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:33.547867 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Started (Lifecycle Event)
May 14 03:37:33.550278 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:37:33.553145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:37:33.553145 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe06:b43a', 'fe80::f459:91ff:fe51:c9cb', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456', 'fe80::fc16:3eff:fee6:b07', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe04:aa6f', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fefd:f920', 'fe80::6ca6:c7ff:fe5a:222d', 'fe80::fc16:3eff:fe20:697e'] 
May 14 03:37:33.553145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:37:33.553498 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:37:33.553538 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:33.553772 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating existing volume attachment record: 9c4b396a-572b-4f55-97c7-955d119382ad {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:37:33.557730 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance spawned successfully.
May 14 03:37:33.559137 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:37:33.807707 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:37:34.038099 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:34.051987 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:34.057110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:34.067466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.068431 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.068431 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.068693 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.069049 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.070086 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:34.108914 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:34.109368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:34.109532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:34.109967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:34.110159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:34.125174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:34.125843 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:34.127303 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:34.127303 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:34.127303 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:34.127303 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:34.139166 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:34.139166 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:34.149277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:34.149277 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:34.157223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912] added
May 14 03:37:34.157223 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:34.157223 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:34.157223 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:34.157223 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:34.157223 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:34.157223 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:34.157527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:34.157592 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:34.157774 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912] added
May 14 03:37:34.164486 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:34.164486 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:34.164486 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:34.237955 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:34.560721 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:37:34.561225 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729854.5607834, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:34.561225 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Paused (Lifecycle Event)
May 14 03:37:34.576630 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Took 8.83 seconds to spawn the instance on the hypervisor.
May 14 03:37:34.576856 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:34.740762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:34.741090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance network_info: |[{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:37:34.743624 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Start _get_guest_xml network_info=[{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:34.745866 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:34.747057 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1793276451', uuid='d2a0afdf-49df-42a9-b430-11871f7a16ef'), owner=OwnerMeta(userid='71a50ef37e66489cbf8dc1dde0950769', username='tempest-ServerActionsTestOtherA-882285516-project-member', projectid='37a8404c7d33468cab5b1fb42b63d221', projectname='tempest-ServerActionsTestOtherA-882285516'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729854.7467074) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:34.748058 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:34.748460 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:34.749242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:34.749478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:34.750576 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:34.751037 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:34.751259 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:34.751402 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:34.751538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:34.751628 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:34.751728 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:34.751899 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:34.751998 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:34.752228 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:34.752357 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:34.752475 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:34.765093 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1793276451',display_name='tempest-ServerActionsTestOtherA-server-1793276451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1793276451',id=24,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-r9cb3nxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=d2a0afdf-49df-42a9-b430-11871f7a16ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:34.765348 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:34.765893 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:34.766503 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'pci_devices' on Instance uuid d2a0afdf-49df-42a9-b430-11871f7a16ef {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:34.856593 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:34.995314 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-78c64be9-19ae-435a-9a67-89e8ffb94232 req-5b4c497b-5e50-4c89-ab1f-6eb145d81a2f service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state None.
May 14 03:37:35.063954 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:35.067690 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729855.0670886, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:35.067971 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Resumed (Lifecycle Event)
May 14 03:37:35.084828 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Took 20.24 seconds to build instance.
May 14 03:37:35.158678 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:35.166199 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:35.179319 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:35.179319 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:35.185029 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:35.185029 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.195953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.206362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.219668 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.229983 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <uuid>d2a0afdf-49df-42a9-b430-11871f7a16ef</uuid>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <name>instance-00000018</name>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherA-server-1793276451</nova:name>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:34</nova:creationTime>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:user uuid="71a50ef37e66489cbf8dc1dde0950769">tempest-ServerActionsTestOtherA-882285516-project-member</nova:user>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:project uuid="37a8404c7d33468cab5b1fb42b63d221">tempest-ServerActionsTestOtherA-882285516</nova:project>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         <nova:port uuid="d42b1eb4-3b46-484f-8eb9-976dce88b189">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="serial">d2a0afdf-49df-42a9-b430-11871f7a16ef</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="uuid">d2a0afdf-49df-42a9-b430-11871f7a16ef</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.config"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:93:0b:21"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <target dev="tapd42b1eb4-3b"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/console.log" append="off"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:35.271057 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Preparing to wait for external event network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:35.271057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1793276451',display_name='tempest-ServerActionsTestOtherA-server-1793276451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1793276451',id=24,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-r9cb3nxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=d2a0afdf-49df-42a9-b430-11871f7a16ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:35.277127 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:37:35.278422 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.278630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bac9e083-aecc-5b48-bcf4-e12c054c026a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:35.279872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.280446 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.40.100,3260]
May 14 03:37:35.280446 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.40.100,3260] successful.
May 14 03:37:35.280446 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.281600 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:35.282721 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.287685 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.288168 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd42b1eb4-3b, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:35.288747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd42b1eb4-3b, col_values=(('qos', UUID('09e4478f-dddb-460c-a0fd-986dc1749832')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:35.289485 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd42b1eb4-3b, col_values=(('external_ids', {'iface-id': 'd42b1eb4-3b46-484f-8eb9-976dce88b189', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:0b:21', 'vm-uuid': 'd2a0afdf-49df-42a9-b430-11871f7a16ef'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:35.290620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.50.100,3260]
May 14 03:37:35.290620 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.50.100,3260] successful.
May 14 03:37:35.290620 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.291495 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.293304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:35.302495 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:35.303586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.308554 np0000000741 nova-compute[97948]: INFO os_vif [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b')
May 14 03:37:35.315974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.331301 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.332147 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:35.332147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:35.333981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] HCTL ('11', '-', '-', 0) found on session 64 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:35.334307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.334592 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:35.335944 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:35.335944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:35.339220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] HCTL ('12', '-', '-', 0) found on session 65 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:35.339358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:35.372347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching for a device in session 64 and hctl ['11', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:35.372347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching for a device in session 65 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:35.372347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:35.571352 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:35.573756 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:35.588036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-22cf672f-99df-4578-aaf5-5417c824ec4f tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.762s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:36.362078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching for a device in session 64 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:36.362465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:36.521512 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Rescuing
May 14 03:37:36.521512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:36.521512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:36.521512 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:36.830672 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:36.831133 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:36.831317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:93:0b:21, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:36.831921 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Using config drive
May 14 03:37:37.025667 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:37.145571 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Found WWN 330000000e39064f3 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:37.145946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:37.146179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000e39064f3', 'path': '/dev/dm-2', 'multipath_id': '330000000e39064f3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:37.146360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e39064f3', 'path': '/dev/dm-2', 'multipath_id': '330000000e39064f3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:37.148768 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'flavor' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:37.341746 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:37.418530 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:37.563101 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Creating config drive at /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.config
May 14 03:37:37.569250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6e665j1l {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:37.619620 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:37.622147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6e665j1l" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:37.652100 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attempting to attach volume 4ee06340-b4e7-4638-8043-b0bbc4dbe912 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:37:37.654855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:   <alias name="ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912"/>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:   <serial>4ee06340-b4e7-4638-8043-b0bbc4dbe912</serial>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:37.654855 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:37:38.123419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:38.204484 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.245232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.345001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.421981 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.433578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-46777723-0909-4a81-8a3a-64ee2252667f req-06ab094d-423b-4c4e-8329-67411ff6bf49 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:38.433578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-46777723-0909-4a81-8a3a-64ee2252667f req-06ab094d-423b-4c4e-8329-67411ff6bf49 service nova] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:38.433578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-46777723-0909-4a81-8a3a-64ee2252667f req-06ab094d-423b-4c4e-8329-67411ff6bf49 service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:38.433578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-46777723-0909-4a81-8a3a-64ee2252667f req-06ab094d-423b-4c4e-8329-67411ff6bf49 service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:38.433578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-46777723-0909-4a81-8a3a-64ee2252667f req-06ab094d-423b-4c4e-8329-67411ff6bf49 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Processing event network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:37:38.516939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.519347 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.550067 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:38.553011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.166960 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729859.166442, d2a0afdf-49df-42a9-b430-11871f7a16ef => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:39.167404 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] VM Started (Lifecycle Event)
May 14 03:37:39.168657 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:37:39.172448 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:37:39.177666 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance spawned successfully.
May 14 03:37:39.177666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:37:39.391195 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:39.391195 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:39.391395 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:39.391457 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No VIF found with MAC fa:16:3e:21:f6:2f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:39.670178 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:39.671850 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:39.684598 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.684723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.685029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.685287 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.685534 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.685764 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:37:39.756418 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.760616 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.791695 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.899087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.909751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:39.964427 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:39.964629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:39.964836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:39.964982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:39.965199 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:39.965329 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-ca58442d-db39-41b5-be6c-7d6a288b43c9 req-03264ad3-3484-4199-847b-926714892ed3 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:40.073501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.108234 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance destroyed successfully.
May 14 03:37:40.108657 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'numa_topology' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:40.124978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.135324 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.150911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.174959 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:37:40.176465 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729860.1754806, d2a0afdf-49df-42a9-b430-11871f7a16ef => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:40.176465 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] VM Paused (Lifecycle Event)
May 14 03:37:40.194583 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Took 7.66 seconds to spawn the instance on the hypervisor.
May 14 03:37:40.194838 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:40.251109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.258937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.291423 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.401774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.409272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:40.506598 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:40.507037 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:40.507192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:40.507844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:40.508008 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] No waiting events found dispatching network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:40.508207 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e1590ab4-6cbe-437c-b2cf-3f6a1b735c8b req-b0b86609-3321-4660-ad64-7c1c7c3ed0ee service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received unexpected event network-vif-plugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 for instance with vm_state active and task_state None.
May 14 03:37:40.621442 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Attempting a stable device rescue
May 14 03:37:40.680379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:40.685539 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729860.683835, d2a0afdf-49df-42a9-b430-11871f7a16ef => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:40.685539 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] VM Resumed (Lifecycle Event)
May 14 03:37:40.713752 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Took 13.58 seconds to build instance.
May 14 03:37:40.759653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:37:40.762836 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:37:40.763013 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Creating image(s)
May 14 03:37:40.763550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:40.763769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:40.764327 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:40.764528 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:40.965968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6bc041c0-f5a6-4da4-9082-ab8c30104390 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.554s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:41.014766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:41.014766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:41.189372 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:41.190840 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:41.217228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.089s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:41.266508 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:41.268657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "49392adccb49aa2af5be372f4f6f5027a2491509" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:41.268657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "49392adccb49aa2af5be372f4f6f5027a2491509" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:41.471934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:41.472499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:41.473794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:41.473794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:41.473794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:41.476739 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Terminating instance
May 14 03:37:41.496533 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Rescuing
May 14 03:37:41.496533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:41.496533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:41.496533 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:41.521158 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:41.694420 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999721107000141 future=<Future at 0x79d0b0178800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:41.696184 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999069828000074 future=<Future at 0x79d0b0178800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:41.696184 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998872033999987 future=<Future at 0x79d0b0178800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:41.825655 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:41.828049 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:41.828354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:41.913981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.part --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:41.914565 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] 952b7c6f-b005-463d-a75d-59ab9807f662 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:37:41.915156 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:37:41.915426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.part /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:41.984404 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:37:42.002446 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:42.005794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.part /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.converted" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:42.015097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:42.044995 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.051446 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Ignoring supplied device name: /dev/vdb
May 14 03:37:42.061565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.097946 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.098577 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.098844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.098988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.099226 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.099800 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:42.099800 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.099800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.099962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.099962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.100375 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.100375 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:42.100613 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.100613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.101127 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.101127 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.101127 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.101127 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:42.101403 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.101602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.101770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.101887 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.105472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.109761 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-462e4012-6c9d-4594-b0f3-68fe8c89fd38 req-530c3d28-e353-4271-bae0-ebb44318479e service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:42.145531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:42.146974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "49392adccb49aa2af5be372f4f6f5027a2491509" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.879s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.147238 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:42.154702 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:42.157969 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "49392adccb49aa2af5be372f4f6f5027a2491509" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.158602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "49392adccb49aa2af5be372f4f6f5027a2491509" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.160479 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:42.165974 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:42.166780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:42.259306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:42.260911 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509,backing_fmt=raw /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:42.281713 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:42.284168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:42.284952 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:42.285154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.285326 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] No waiting events found dispatching network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:42.285487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-35092e3b-f2e7-4ec6-85a8-934f420a3d80 req-a55d2ed5-adc6-404a-831d-05353b7fa0e1 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:37:42.328684 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49392adccb49aa2af5be372f4f6f5027a2491509,backing_fmt=raw /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.rescue" returned: 0 in 0.067s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:42.329672 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "49392adccb49aa2af5be372f4f6f5027a2491509" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.329672 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'migration_context' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:42.339742 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999553278000121 future=<Future at 0x79d0b83c70b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:42.344292 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Instance destroyed successfully.
May 14 03:37:42.344955 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lazy-loading 'resources' on Instance uuid 3defa392-75f0-4f24-b15d-d14ec40200cf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:42.560467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.546s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:42.640626 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:42.813661 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:42.842174 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:42.842494 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:37:42.843243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start _get_guest_xml network_info=[{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:20:69:7e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '952b7c6f-b005-463d-a75d-59ab9807f662', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': '3273e916-e64e-40be-acfc-17ecdfb15f04', 'attached_at': '', 'detached_at': '', 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'serial': '5fc43301-192c-4b7f-a57b-89793b9f9364'}, 'boot_index': 0, 'attachment_id': '1b6eb5c1-e7c6-4469-913c-4c204893cb7a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:42.843504 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:42.847823 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1274014777',display_name='tempest-SnapshotDataIntegrityTests-server-1274014777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-snapshotdataintegritytests-server-1274014777',id=14,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL863LVRDnKVJbAe3wuwW6qULDc/xnW/kGqo/qVXzO/hELZb0ydoy32qfZTzlvGBQRIrFErqY76jBgdk8Q+e/4LyIABVoXCXEHyOGfAtwxUnLDmKZ02Jdq/mAX9IPuU+w==',key_name='tempest-keypair-1105384263',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:24Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='817445e1e7da4d278a96c6cdd6c14c0e',ramdisk_id='',reservation_id='r-8491v06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-596615631',owner_user_name='tempest-SnapshotDataIntegrityTests-596615631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53104358366841619575ce8b9b680e01',uuid=3defa392-75f0-4f24-b15d-d14ec40200cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:37:42.848058 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converting VIF {"id": "620119d0-d806-4e90-b497-d5103f24a42d", "address": "fa:16:3e:06:b4:3a", "network": {"id": "adc4b7e6-9467-4fe0-baa0-da9e8dab1922", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1644291369-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "817445e1e7da4d278a96c6cdd6c14c0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap620119d0-d8", "ovs_interfaceid": "620119d0-d806-4e90-b497-d5103f24a42d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:42.848565 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:42.848789 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:37:42.854893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.854893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap620119d0-d8, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:42.856588 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:42.862141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.863808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.864150 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b2de75b-fd8e-436b-97c5-31ed5c0069bb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:37:42.864957 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.865880 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:37:42.871248 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:42.873857 np0000000741 nova-compute[97948]: INFO os_vif [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b4:3a,bridge_name='br-int',has_traffic_filtering=True,id=620119d0-d806-4e90-b497-d5103f24a42d,network=Network(adc4b7e6-9467-4fe0-baa0-da9e8dab1922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620119d0-d8')
May 14 03:37:42.874410 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Deleting instance files /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf_del
May 14 03:37:42.875608 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Deletion of /opt/stack/data/nova/instances/3defa392-75f0-4f24-b15d-d14ec40200cf_del complete
May 14 03:37:43.315908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:43.346877 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:43.351716 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:43.351716 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484', uuid='3273e916-e64e-40be-acfc-17ecdfb15f04'), owner=OwnerMeta(userid='3fe2ffc6cce044f7ad75df57827bc19e', username='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member', projectid='6177683ef84349e5a26042f334b26ddd', projectname='tempest-ServerBootFromVolumeStableRescueTest-965770094'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:20:69:7e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729863.3498242) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:43.351716 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:43.351716 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:43.353085 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:43.353316 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:43.354498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:43.354941 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:43.355128 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:43.355262 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:43.355487 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:43.355610 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:43.355787 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:43.356089 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:43.356262 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:43.356428 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:43.356652 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:43.356840 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:43.357036 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:43.382206 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 03:37:43.382809 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:37:43.383090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:37:43.383214 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:37:43.383428 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:43.427109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:43.467677 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:43.756460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:43.756660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:43.756945 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Attaching volume ae87b32e-5417-4eb4-b1f5-64c55a34b271 to /dev/vdb
May 14 03:37:43.814898 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:43.829722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:37:43.860589 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:43.875481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:43.909565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:43.929520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:37:43.930041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:37:43.940810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4919e673-5822-4d06-b675-009d6bf2d0bd req-4f7c6398-c390-4f11-aea8-954dacf54ad5 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-deleted-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:43.940810 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-4919e673-5822-4d06-b675-009d6bf2d0bd req-4f7c6398-c390-4f11-aea8-954dacf54ad5 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Neutron deleted interface 620119d0-d806-4e90-b497-d5103f24a42d; detaching it from the instance and deleting it from the info cache
May 14 03:37:43.941211 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4919e673-5822-4d06-b675-009d6bf2d0bd req-4f7c6398-c390-4f11-aea8-954dacf54ad5 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:43.954277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:37:43.955708 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe24:3456', 'fe80::fc16:3eff:fee6:b07', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe04:aa6f', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fefd:f920', 'fe80::6ca6:c7ff:fe5a:222d', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83'] 
May 14 03:37:43.955892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:37:43.956433 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:37:43.957514 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:43.957771 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating existing volume attachment record: f1be200a-65fe-481e-b91d-b39cc9da0ceb {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:37:44.008203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:44.010328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:44.010651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:44.010651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:44.023668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:44.025262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:44.025985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:44.026274 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:44.027162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:44.027162 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:44.044207 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:44.044207 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:44.056960 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:44.056960 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:44.059602 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:44.071964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:44.087135 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:44.087452 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:44.087599 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:44.087599 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:44.088253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('14', '0', '0', 0) found on session 62 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:44.088373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:44.093155 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:44.093416 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:44.093715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:44.093898 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:44.094517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] HCTL ('15', '0', '0', 0) found on session 63 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:44.094517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:44.101210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 62 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:44.101512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:44.104179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Searching for a device in session 63 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:44.104307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:44.159820 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:44.159820 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing instance network info cache due to event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:37:44.159820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] Acquiring lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:44.159820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] Acquired lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:44.159820 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing network info cache for port d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:37:44.331852 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:44.332217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] Acquiring lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:44.332450 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:44.332450 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:44.332568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] No waiting events found dispatching network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:44.332740 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-580c2ae5-42d2-48dc-a183-c90e7c2b471d req-2de30ec4-c964-4311-9816-6b70a4890787 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Received event network-vif-unplugged-620119d0-d806-4e90-b497-d5103f24a42d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:37:44.400836 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:44.467506 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4919e673-5822-4d06-b675-009d6bf2d0bd req-4f7c6398-c390-4f11-aea8-954dacf54ad5 service nova] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Detach interface failed, port_id=620119d0-d806-4e90-b497-d5103f24a42d, reason: Instance 3defa392-75f0-4f24-b15d-d14ec40200cf could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:37:44.521307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:44.521573 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:44.521764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:44.664673 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:44.903181 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Took 1.52 seconds to deallocate network for instance.
May 14 03:37:44.987492 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:44.997766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.004680 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.026956 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.029502 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:37:45.034099 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.076908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.199818 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updated VIF entry in instance network info cache for port d42b1eb4-3b46-484f-8eb9-976dce88b189. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:37:45.200112 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:45.294224 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.311167 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:45.329891 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999682976000031 future=<Future at 0x79d0b0018110 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:45.332016 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance destroyed successfully.
May 14 03:37:45.336267 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'numa_topology' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:45.410107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:45.410400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:45.702427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58032230-1807-4a06-afeb-8eaecbaaa78f req-fd3c0b0b-fa9b-4fee-8e58-098f32f7ff4f service nova] Releasing lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:45.847969 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attempting a stable device rescue
May 14 03:37:45.962341 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:37:45.966935 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:37:45.967153 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Creating image(s)
May 14 03:37:45.967863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:45.968082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:45.968650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:45.968851 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'trusted_certs' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:45.981751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:37:45.981968 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:37:46.044557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Found WWN 330000000f9900e53 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:46.044864 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:46.045090 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '330000000f9900e53', 'path': '/dev/dm-3', 'multipath_id': '330000000f9900e53'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:46.045210 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f9900e53', 'path': '/dev/dm-3', 'multipath_id': '330000000f9900e53'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:46.045587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.524s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:46.045837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:46.057500 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:46.057869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:46.058838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:46.059099 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:46.059446 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:46.059663 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:46.072474 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:46.072474 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:46.077693 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:37:46.077693 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:46.086748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271] added
May 14 03:37:46.086748 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:46.086748 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:46.086748 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:46.086748 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:46.086748 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:46.086748 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:46.087186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:46.087186 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:46.087467 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:46.088832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271] added
May 14 03:37:46.088832 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:37:46.088832 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:46.088832 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:46.088832 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:37:46.088832 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:37:46.088832 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:46.089070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:37:46.089219 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:37:46.089298 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:37:46.404655 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state rescuing.
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:46.405799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:46.406114 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a8eb8ba5-1425-4e08-a4b9-cb6fbb241d1d req-e9668218-33b2-44cd-9ad1-eac558483a9c service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state rescuing.
May 14 03:37:46.471017 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:46.471376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:46.471816 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:46.486667 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:37:46.550840 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-453469484',id=23,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:34Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-wm7j1rtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:35Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3273e916-e64e-40be-acfc-17ecdfb15f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:20:69:7e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:46.551133 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "vif_mac": "fa:16:3e:20:69:7e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:46.551812 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:46.552439 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'pci_devices' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:46.995856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.585s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:47.054372 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:47.055820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <uuid>3273e916-e64e-40be-acfc-17ecdfb15f04</uuid>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <name>instance-00000017</name>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-453469484</nova:name>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:43</nova:creationTime>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:user uuid="3fe2ffc6cce044f7ad75df57827bc19e">tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member</nova:user>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:project uuid="6177683ef84349e5a26042f334b26ddd">tempest-ServerBootFromVolumeStableRescueTest-965770094</nova:project>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         <nova:port uuid="823bc695-29a1-4bb8-bf76-ce875e310182">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="serial">3273e916-e64e-40be-acfc-17ecdfb15f04</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="uuid">3273e916-e64e-40be-acfc-17ecdfb15f04</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <alias name="ua-5fc43301-192c-4b7f-a57b-89793b9f9364"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-3"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <serial>5fc43301-192c-4b7f-a57b-89793b9f9364</serial>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.rescue"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <boot order="1"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:20:69:7e"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <target dev="tap823bc695-29"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/console.log" append="off"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:47.055820 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:47.060312 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance destroyed successfully.
May 14 03:37:47.066785 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Deleted allocations for instance 3defa392-75f0-4f24-b15d-d14ec40200cf
May 14 03:37:47.087711 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:47.089926 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:47.107694 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:47.107694 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:47.111535 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:47.111535 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.124665 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.127512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.148436 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.148825 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.157461 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.157943 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:47.199544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.40.100,3260]
May 14 03:37:47.199544 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.40.100,3260] successful.
May 14 03:37:47.199544 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.211189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.50.100,3260]
May 14 03:37:47.211189 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.50.100,3260] successful.
May 14 03:37:47.211189 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.212868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.224334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.233321 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.233689 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:47.233886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:47.234069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:47.241273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] HCTL ('16', '-', '-', 0) found on session 67 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:47.241467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.248756 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ab89a0a-b6f9-4292-a754-e8041c739cc1 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:47.249095 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:47.249815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:47.249815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:47.250594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] HCTL ('17', '-', '-', 0) found on session 68 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:47.250785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:47.256356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching for a device in session 67 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:47.256585 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:47.265553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching for a device in session 68 and hctl ['17', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:47.363734 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.365821 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.366776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:47.470229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.part --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:47.471139 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] bf7b9011-a283-497d-9634-410d195c7e73 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:37:47.472344 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:37:47.472938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.part /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:47.670395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.part /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.converted" returned: 0 in 0.196s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:47.698661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:47.810505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27.converted --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:47.811347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.339s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:47.811977 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.816292 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.817840 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:47.818221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:47.818581 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.822666 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:37:47.823171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:47.866323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:47.920779 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27 --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:47.921250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27,backing_fmt=raw /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:47.971061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/523c0b1698ceca5da92cf9b66981bf1eeb8a2e27,backing_fmt=raw /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.rescue" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:47.971677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "523c0b1698ceca5da92cf9b66981bf1eeb8a2e27" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:47.972174 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'migration_context' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:48.081007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea0930e5-3b40-4183-a009-e183dbbf41a6 tempest-SnapshotDataIntegrityTests-596615631 tempest-SnapshotDataIntegrityTests-596615631-project-member] Lock "3defa392-75f0-4f24-b15d-d14ec40200cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.609s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:48.265613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching for a device in session 68 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:48.265613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:48.429668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:48.474878 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:48.475291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:37:48.478241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start _get_guest_xml network_info=[{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "vif_mac": "fa:16:3e:21:f6:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf7b9011-a283-497d-9634-410d195c7e73', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '646c78c0-bf19-4d90-80ed-e79836dc0ecf', 'attached_at': '', 'detached_at': '', 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'serial': '4ee06340-b4e7-4638-8043-b0bbc4dbe912'}, 'boot_index': None, 'attachment_id': '9c4b396a-572b-4f55-97c7-955d119382ad', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:37:48.479897 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'resources' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:48.586752 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:48.586909 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:48.586944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:48.587038 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] No VIF found with MAC fa:16:3e:20:69:7e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:48.587568 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Using config drive
May 14 03:37:48.981467 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:48.985673 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:37:48.987147 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2053616745', uuid='646c78c0-bf19-4d90-80ed-e79836dc0ecf'), owner=OwnerMeta(userid='c22726ed0c7244b6a428e2a6f49d9e07', username='tempest-ServerStableDeviceRescueTest-1584222625-project-member', projectid='203276d61c614abaab90c3d9d6e99e0e', projectname='tempest-ServerStableDeviceRescueTest-1584222625'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "vif_mac": "fa:16:3e:21:f6:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729868.9867048) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:37:48.989091 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:37:48.989325 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:37:48.991235 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:37:48.991558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:37:48.993065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:37:48.993671 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:37:48.994032 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:37:48.994115 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:37:48.994395 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:37:48.994576 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:37:48.994786 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:37:48.995166 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:37:48.995264 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:37:48.995453 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:37:48.995697 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:37:48.995936 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:37:48.996214 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'vcpu_model' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:49.082743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found WWN 33000000065065f29 for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:49.083152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:49.083418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== connect_volume: return (4561ms) {'type': 'block', 'scsi_wwn': '33000000065065f29', 'path': '/dev/dm-6', 'multipath_id': '33000000065065f29'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:49.083618 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000065065f29', 'path': '/dev/dm-6', 'multipath_id': '33000000065065f29'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:49.086404 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:49.090110 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'ec2_ids' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:49.499087 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:49.515479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:49.590987 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Attempting to attach volume ae87b32e-5417-4eb4-b1f5-64c55a34b271 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:37:49.593308 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:   <alias name="ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271"/>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:   <serial>ae87b32e-5417-4eb4-b1f5-64c55a34b271</serial>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:49.593308 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:37:49.594357 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:49.594546 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'keypairs' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:49.615140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:49.615587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:49.615855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:49.616545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:49.616921 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:37:49.617302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:49.617436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:49.618133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:49.618133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:37:49.641876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:49.642690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:49.643125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:49.643417 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:37:49.644975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:49.644975 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:49.659971 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:49.659971 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:37:49.665398 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:37:49.665398 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:49.680795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:49.690212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.702362 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.702881 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:49.703859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:49.703859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:49.704069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] HCTL ('12', '0', '0', 0) found on session 65 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:49.704252 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.713800 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:49.714679 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:49.714987 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching for a device in session 65 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:49.715036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:49.717466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:49.717466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:37:49.717466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] HCTL ('11', '0', '0', 0) found on session 64 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:37:49.717466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:37:49.726748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Searching for a device in session 64 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:37:49.726894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:37:50.098289 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:50.101007 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:50.240147 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Creating config drive at /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config.rescue
May 14 03:37:50.244999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv9b_hj0m {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:50.315190 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv9b_hj0m" returned: 0 in 0.070s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:50.627863 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.643475 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:37:50.782270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.816663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.821136 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.928818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.957826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:50.967864 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:51.120653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:51.120948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:51.121236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:51.121939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:51.122290 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:51.122486 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0fcff9b3-f246-40b1-be12-8bd107190d4d req-26fab48e-6995-43b2-9f03-97b54e0eec41 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state active and task_state rescuing.
May 14 03:37:51.308815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:51.308815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:51.308815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:51.308815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No VIF found with MAC fa:16:3e:e6:0b:07, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:51.663407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Found WWN 330000000e39064f3 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:37:51.663841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:51.663988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '330000000e39064f3', 'path': '/dev/dm-2', 'multipath_id': '330000000e39064f3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:51.664083 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e39064f3', 'path': '/dev/dm-2', 'multipath_id': '330000000e39064f3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:37:51.760096 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 3273e916-e64e-40be-acfc-17ecdfb15f04 due to new event <LifecycleEvent: 1778729871.7595174, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:37:51.760406 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729871.7595174, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:51.760600 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Resumed (Lifecycle Event)
May 14 03:37:51.764004 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1a44e153-3f84-4742-a2b6-30250ffac24c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:51.933495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:51.933495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:52.170086 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2053616745',display_name='tempest-ServerStableDeviceRescueTest-server-2053616745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverstabledevicerescuetest-server-2053616745',id=19,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOehng1ilN6xqQk2M0LzjjdlGsdHiekcawpTfGWtNTCkZBR2H6IUvn/vOdjKk0dQxjkhax8hhlAK4q0kgWTk4/A46IvTm6uLKWVFxX2k0jchU58RoM6BWd+tZrVtbDN35w==',key_name='tempest-keypair-1256657895',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:41Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='203276d61c614abaab90c3d9d6e99e0e',ramdisk_id='',reservation_id='r-2hifa2g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1584222625',owner_user_name='tempest-ServerStableDeviceRescueTest-1584222625-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c22726ed0c7244b6a428e2a6f49d9e07',uuid=646c78c0-bf19-4d90-80ed-e79836dc0ecf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "vif_mac": "fa:16:3e:21:f6:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:37:52.170328 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converting VIF {"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "vif_mac": "fa:16:3e:21:f6:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:37:52.171224 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:37:52.173418 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'pci_devices' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:52.265273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:52.269382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:52.436355 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Detaching volume f45268d7-fef7-4c09-80f4-42bf858fa27d
May 14 03:37:52.504539 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Attempting to driver detach volume f45268d7-fef7-4c09-80f4-42bf858fa27d from mountpoint /dev/vdb
May 14 03:37:52.513589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdb by alias ua-f45268d7-fef7-4c09-80f4-42bf858fa27d {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:52.515094 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdb by alias ua-f45268d7-fef7-4c09-80f4-42bf858fa27d {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:37:52.515198 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Attempting to detach device vdb from instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:37:52.515411 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <alias name="ua-f45268d7-fef7-4c09-80f4-42bf858fa27d"/>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <serial>f45268d7-fef7-4c09-80f4-42bf858fa27d</serial>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:52.515411 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:52.523407 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdb from instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba from the persistent domain config.
May 14 03:37:52.523545 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] (1/8): Attempting to detach device vdb with device alias ua-f45268d7-fef7-4c09-80f4-42bf858fa27d from instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:37:52.523785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <alias name="ua-f45268d7-fef7-4c09-80f4-42bf858fa27d"/>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <serial>f45268d7-fef7-4c09-80f4-42bf858fa27d</serial>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]: </disk>
May 14 03:37:52.523785 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:37:52.675573 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:52.676627 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] End _get_guest_xml xml=<domain type="qemu">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <uuid>646c78c0-bf19-4d90-80ed-e79836dc0ecf</uuid>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <name>instance-00000013</name>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2053616745</nova:name>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:37:48</nova:creationTime>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:user uuid="c22726ed0c7244b6a428e2a6f49d9e07">tempest-ServerStableDeviceRescueTest-1584222625-project-member</nova:user>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:project uuid="203276d61c614abaab90c3d9d6e99e0e">tempest-ServerStableDeviceRescueTest-1584222625</nova:project>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         <nova:port uuid="9acf5057-6375-40ad-b805-32e6e0890442">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <system>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="serial">646c78c0-bf19-4d90-80ed-e79836dc0ecf</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="uuid">646c78c0-bf19-4d90-80ed-e79836dc0ecf</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </system>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <os>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </os>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <features>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </features>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   <devices>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <alias name="ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-2"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <serial>4ee06340-b4e7-4638-8043-b0bbc4dbe912</serial>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.rescue"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <target dev="vdc" bus="virtio"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <boot order="1"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </disk>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:21:f6:2f"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <target dev="tap9acf5057-63"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </interface>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/console.log" append="off"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </serial>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <video>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </video>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </rng>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:   </devices>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]: </domain>
May 14 03:37:52.676627 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:37:52.687844 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance destroyed successfully.
May 14 03:37:52.772126 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729872.7717626, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:52.772528 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Started (Lifecycle Event)
May 14 03:37:52.832764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:52.868179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:52.896839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-54807687-de39-47b0-a36e-1a39ebe02a15 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.140s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:53.229439 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:53.229656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:53.229837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:53.230087 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:53.230153 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:53.230285 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-02ec7c35-dfab-44df-b48f-3ecf4fa75636 req-40dd333f-2acb-481f-89b9-7120b50e33c0 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state rescued and task_state unrescuing.
May 14 03:37:53.237568 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f45268d7-fef7-4c09-80f4-42bf858fa27d for instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:37:53.277391 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:53.278935 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:53.431698 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:53.482886 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Unrescuing
May 14 03:37:53.483130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:53.483270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquired lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:53.483428 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:53.788753 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:37:53.788753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729873.7885277, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => ua-f45268d7-fef7-4c09-80f4-42bf858fa27d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:37:53.792553 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdb from instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba from the live domain config.
May 14 03:37:53.795793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:37:53.796295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:37:53.796477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:37:53.798117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:37:53.799414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f45268d7-fef7-4c09-80f4-42bf858fa27d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:37:53.799619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:53.837471 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:37:53.837933 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '68')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:37:53.837933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '57')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:53.838740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d', '58')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:37:53.839513 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b04396c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:37:53.839731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:37:53.839950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flush multipath device 330000000e5aa0dba {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:37:53.877044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:53.913259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:37:53.967119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:37:53.967295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:37:53.968579 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:37:53.985965 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:53.988366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:37:53.988366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:37:54.004047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.048215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260]
May 14 03:37:54.048215 np0000000741 nova-compute[97948]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.40.100,3260] successful.
May 14 03:37:54.048215 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.067791 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.079662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.120509 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260]
May 14 03:37:54.120509 np0000000741 nova-compute[97948]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-f45268d7-fef7-4c09-80f4-42bf858fa27d, portal: 192.168.50.100,3260] successful.
May 14 03:37:54.120509 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.137210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:37:54.137438 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:37:54.137574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== disconnect_volume: return (340ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:37:54.137704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:37:54.220169 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:54.220298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:54.220417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:54.220538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:37:54.220706 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] No VIF found with MAC fa:16:3e:21:f6:2f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:37:54.221379 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Using config drive
May 14 03:37:54.325318 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:54.513046 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [{"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:37:54.697074 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:54.731961 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'ec2_ids' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:55.015420 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Releasing lock "refresh_cache-3273e916-e64e-40be-acfc-17ecdfb15f04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:37:55.016032 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'flavor' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:55.234947 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:55.235148 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'keypairs' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:55.547445 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:55.550330 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:55.578132 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:55.689419 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:55.700194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:55.703531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-987a5b20-6225-47f1-acfe-cee1f52ace6a tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.770s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:55.737486 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:55.743974 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:37:55.789782 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:55.789979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:55.790170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:55.790283 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:55.790395 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:55.791154 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9f67117e-41d7-4462-8b1b-87bc297042f8 req-c026ee0d-32ef-405b-9112-980928b094dd service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state rescued and task_state unrescuing.
May 14 03:37:55.874753 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99964418500008 future=<Future at 0x79d090755d60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:55.876769 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance destroyed successfully.
May 14 03:37:55.878244 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'numa_topology' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:55.943872 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Creating config drive at /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config.rescue
May 14 03:37:55.948058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0mdx7365 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:37:56.004200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0mdx7365" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:37:56.198805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:56.198805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:56.198805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:56.199466 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97948) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 03:37:56.200420 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:56.381041 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Object Instance<3273e916-e64e-40be-acfc-17ecdfb15f04> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:56.590664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.629381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.694665 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003647649998583802 future=<Future at 0x79d0b0178800 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:56.694665 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:56.694665 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.6442340979999699 future=<Future at 0x79d0b83c70b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:56.694851 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.6441277730000365 future=<Future at 0x79d0b83c70b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:56.840213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.855249 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:56.855249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:56.857423 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:56.857662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:56.857835 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:56.858024 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-bf51fc0a-73d9-422d-98c9-579eeb15e422 req-19eb5981-4333-4155-9110-08aae14e4069 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state rescuing.
May 14 03:37:56.924228 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.932979 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.961614 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:56.967364 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.083028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.123265 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.241669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.246930 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.257621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.273126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.279874 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.302666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.332765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.339971 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003942309999729332 future=<Future at 0x79d0b83c70b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:57.340376 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Emitting event <LifecycleEvent: 1778729862.3387976, 3defa392-75f0-4f24-b15d-d14ec40200cf => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:57.340663 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:57.340844 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] VM Stopped (Lifecycle Event)
May 14 03:37:57.341388 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.9881269200000133 future=<Future at 0x79d0b0018110 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:57.341471 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.9880283979998694 future=<Future at 0x79d0b0018110 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:57.537743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.571484 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999521086999948 future=<Future at 0x79d0b04824b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:37:57.576552 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance destroyed successfully.
May 14 03:37:57.576873 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:57.582755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.606697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.847463 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 3defa392-75f0-4f24-b15d-d14ec40200cf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:57.873997 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.883950 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:57.885248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:57.886202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:57.886202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:57.886202 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:57.886202 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state rescued and task_state unrescuing.
May 14 03:37:57.886202 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:57.886470 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:57.886838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:57.887007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:57.891083 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:57.892075 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state rescued and task_state unrescuing.
May 14 03:37:57.892239 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:57.892445 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:57.892626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:57.892779 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:57.892924 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:57.893062 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received unexpected event network-vif-plugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with vm_state rescued and task_state unrescuing.
May 14 03:37:57.893189 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:57.893332 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:57.893487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:57.896611 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:57.896903 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:57.897113 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dcb0d937-eda5-4934-9371-060cda094c11 req-baf7481e-f88b-46a6-a33b-d54f09085d2d service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state active and task_state powering-off.
May 14 03:37:57.944563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.955955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.955955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.989289 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:57.998875 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:58.081864 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:37:58.082067 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:58.116711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:58.140966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:58.146684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:58.158196 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 646c78c0-bf19-4d90-80ed-e79836dc0ecf due to new event <LifecycleEvent: 1778729878.157837, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:37:58.158330 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729878.157837, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:58.158458 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Resumed (Lifecycle Event)
May 14 03:37:58.165285 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b5a738-9acd-411c-b574-9b2d1543e76d tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:58.166384 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7288b9d8-4a39-4f84-83c6-3240498ee61a tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:58.433973 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:37:58.590225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46652488-2d41-4501-aa1a-ad114684f113 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.393s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:58.667321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:58.673065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:58.876282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:58.876462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:58.966192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:37:58.966547 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:58.966660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:58.966827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:37:58.966986 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:37:58.967138 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-887a8c26-7e53-4d2a-bb5f-71b828e003a6 req-13868d30-173d-411f-b176-cbe8aeb7928e service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state rescued and task_state None.
May 14 03:37:59.104966 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:59.176391 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729879.1760883, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:37:59.176958 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Started (Lifecycle Event)
May 14 03:37:59.344872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:59.345397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:59.380260 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:37:59.530103 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Unrescuing
May 14 03:37:59.530733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:59.530733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:59.530733 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:59.613903 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:37:59.613903 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquired lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:37:59.614086 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:37:59.614198 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'info_cache' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:59.679719 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:37:59.685358 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:37:59.849362 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'flavor' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:37:59.945506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:37:59.945783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:37:59.949108 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:37:59.949232 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Claim successful on node np0000000741
May 14 03:38:00.032946 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:00.050590 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:00.051012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.051180 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.051462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.051601 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:00.051742 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:00.051852 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:00.051982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.052118 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.052238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.052355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:00.052521 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:00.052623 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:00.052793 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.052929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.053043 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.053175 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:00.053292 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:00.053399 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:00.053514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.053654 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.053765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.053872 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:00.053982 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:00.054084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:00.054193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.054309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.054426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.054529 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:00.054633 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-09d2947e-92ed-44d4-9867-3d7807248432 req-883970f8-9f4f-4ba5-88c8-3cd24625c3f3 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:00.118902 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:00.190816 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:38:00.191093 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 3273e916-e64e-40be-acfc-17ecdfb15f04 due to new event <LifecycleEvent: 1778729880.1908429, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:38:00.191883 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729880.1908429, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:00.191883 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Resumed (Lifecycle Event)
May 14 03:38:00.329872 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00031259499996849627 future=<Future at 0x79d0b0018110 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330073 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330073 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=10.544269502000134 future=<Future at 0x79d090755d60 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330186 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=10.544194594000146 future=<Future at 0x79d090755d60 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330186 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330248 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.240452006000169 future=<Future at 0x79d0b04824b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.330313 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.240397676000157 future=<Future at 0x79d0b04824b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:00.366140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.366349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.366541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.366701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.366839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.369031 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Terminating instance
May 14 03:38:00.486163 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:00.488111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.488333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:00.603200 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:00.621749 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:00.633277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:00.702504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:00.703847 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:00.854581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:00.874120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:00.898503 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:00.900928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:00.924856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:00.940886 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:00.992564 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Detaching volume ae87b32e-5417-4eb4-b1f5-64c55a34b271
May 14 03:38:01.017659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.028957 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.065993 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Attempting to driver detach volume ae87b32e-5417-4eb4-b1f5-64c55a34b271 from mountpoint /dev/vdb
May 14 03:38:01.078259 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found disk vdb by alias ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:38:01.085476 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found disk vdb by alias ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:38:01.086300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Attempting to detach device vdb from instance c1690ab4-3a36-4896-a922-ab421f9fc8cb from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:38:01.086514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <alias name="ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271"/>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <serial>ae87b32e-5417-4eb4-b1f5-64c55a34b271</serial>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:01.086514 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:38:01.097887 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully detached device vdb from instance c1690ab4-3a36-4896-a922-ab421f9fc8cb from the persistent domain config.
May 14 03:38:01.097887 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] (1/8): Attempting to detach device vdb with device alias ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271 from instance c1690ab4-3a36-4896-a922-ab421f9fc8cb from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:38:01.097887 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <alias name="ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271"/>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <serial>ae87b32e-5417-4eb4-b1f5-64c55a34b271</serial>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:01.097887 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:38:01.105116 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:01.106677 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'flavor' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:01.209623 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] During sync_power_state the instance has a pending task (deleting). Skip.
May 14 03:38:01.211169 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729881.2101712, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:01.211169 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Started (Lifecycle Event)
May 14 03:38:01.217552 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Instance destroyed successfully.
May 14 03:38:01.217552 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid 3273e916-e64e-40be-acfc-17ecdfb15f04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:01.226798 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:01.575216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:01.575511 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:01.642849 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.646079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.662433 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.669572 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.691086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.704060 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.713708 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:01.716433 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999771328999941 future=<Future at 0x79d0b0481c40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:01.724884 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-453469484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-453469484',id=23,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-wm7j1rtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:58Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3273e916-e64e-40be-acfc-17ecdfb15f04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:01.725071 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "823bc695-29a1-4bb8-bf76-ce875e310182", "address": "fa:16:3e:20:69:7e", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823bc695-29", "ovs_interfaceid": "823bc695-29a1-4bb8-bf76-ce875e310182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:01.725615 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:01.725872 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:01.727401 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.727723 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap823bc695-29, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:01.728710 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.729660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:01.733763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Releasing lock "refresh_cache-7d8e14e9-c419-444d-9a38-73b5f8f65cba" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:01.743562 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729881.7428885, c1690ab4-3a36-4896-a922-ab421f9fc8cb => ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:38:01.745239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ae87b32e-5417-4eb4-b1f5-64c55a34b271 for instance c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:38:01.749104 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully detached device vdb from instance c1690ab4-3a36-4896-a922-ab421f9fc8cb from the live domain config.
May 14 03:38:01.750782 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:01.751186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:01.751508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:01.752011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:01.752428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:01.752700 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:01.753409 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.755336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.755336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34837559-8e3f-4fae-b88a-adbceacf8625) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:01.756819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.756819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:01.767582 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:01.769298 np0000000741 nova-compute[97948]: INFO os_vif [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:69:7e,bridge_name='br-int',has_traffic_filtering=True,id=823bc695-29a1-4bb8-bf76-ce875e310182,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823bc695-29')
May 14 03:38:01.770623 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:01.770783 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:01.770873 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:38:01.779290 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271 (non-flash)
May 14 03:38:01.779508 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:01.779709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '68')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:01.779709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '67')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:01.780700 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', '68')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:01.783051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:01.783285 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:01.783448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:01.783537 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:01.783732 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:01.783882 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-569ffaec-5ceb-4d8d-b650-151f82734390 req-eb80bb21-9705-48b3-8450-584366a3fe49 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state rescued and task_state unrescuing.
May 14 03:38:01.785059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b043ac00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'): ({'sdl'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:01.785317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Removing multipathed devices sdk, sdl {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:01.785556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flush multipath device 33000000065065f29 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:01.839185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:01.889605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:01.940679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:01.940833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:01.942263 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:01.950838 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99970722099988 future=<Future at 0x79d0b04645f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:01.952784 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance destroyed successfully.
May 14 03:38:01.953140 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'numa_topology' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:01.954737 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:01.955007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:01.967137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:01.974695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:01.974695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:01.974844 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attaching volume e2431725-eb78-4c32-9d4e-a2f5b07187c7 to /dev/vdb
May 14 03:38:02.010780 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.40.100,3260]
May 14 03:38:02.010780 np0000000741 nova-compute[97948]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.40.100,3260] successful.
May 14 03:38:02.010780 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.022293 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:02.028800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.036731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:38:02.041206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.058856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:02.081334 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:02.087470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.50.100,3260]
May 14 03:38:02.087470 np0000000741 nova-compute[97948]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, portal: 192.168.50.100,3260] successful.
May 14 03:38:02.087470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.097505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:38:02.097827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:38:02.105568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:38:02.106984 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe24:3456', 'fe80::fc16:3eff:fee6:b07', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe04:aa6f', 'fe80::fc16:3eff:fefd:f920', 'fe80::6ca6:c7ff:fe5a:222d', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83'] 
May 14 03:38:02.107692 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:38:02.107692 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:38:02.107692 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:02.107914 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating existing volume attachment record: dabff037-f189-4d6c-b50d-781d27e7d5aa {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:38:02.110603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.110692 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:02.110832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== disconnect_volume: return (359ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:02.110995 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:02.113374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.342s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:02.113934 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5fc43301-192c-4b7f-a57b-89793b9f9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:02.114746 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:02.146718 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:02.146914 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:02.147101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:02.147199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '62')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:02.148777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364', '63')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:02.149682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0438d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:02.149921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Removing multipathed devices sdj, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:02.150179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flush multipath device 330000000f9900e53 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:02.154802 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-changed-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:02.154987 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing instance network info cache due to event network-changed-9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:02.155376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:02.155788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:02.155788 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:02.204488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:02.258108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:02.304336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:02.304570 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:02.305659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:02.317179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:02.317352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:02.327773 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.359901 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.40.100,3260]
May 14 03:38:02.359901 np0000000741 nova-compute[97948]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.40.100,3260] successful.
May 14 03:38:02.359901 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.376804 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.388728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.422572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.50.100,3260]
May 14 03:38:02.422572 np0000000741 nova-compute[97948]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-5fc43301-192c-4b7f-a57b-89793b9f9364, portal: 192.168.50.100,3260] successful.
May 14 03:38:02.422572 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.438299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.438544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:02.438842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== disconnect_volume: return (668ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:02.438985 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:02.439301 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Deleting instance files /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04_del
May 14 03:38:02.439821 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Deletion of /opt/stack/data/nova/instances/3273e916-e64e-40be-acfc-17ecdfb15f04_del complete
May 14 03:38:02.455929 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Object Instance<646c78c0-bf19-4d90-80ed-e79836dc0ecf> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:02.596676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.651s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:02.597197 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:38:02.659451 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:02.660476 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:02.663377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:38:02.664225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:02.664344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:02.664618 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:02.664834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:38:02.675028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:02.676232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:02.676607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:02.677370 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:02.677370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:02.677559 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:02.691175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:02.691175 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.697831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:02.697831 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.702016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:02.702016 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:02.702016 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:02.702016 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:02.702016 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:02.702016 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:02.702016 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.702430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:02.702430 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:02.702513 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:02.711571 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:02.711571 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:02.711571 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:02.711571 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:02.711571 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:02.711571 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:02.711571 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:02.711810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:02.711934 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:02.712098 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:02.746303 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance destroyed successfully.
May 14 03:38:02.746749 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:02.923690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:02.946599 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Took 2.07 seconds to destroy the instance on the hypervisor.
May 14 03:38:02.947204 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:02.947551 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:02.947907 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:02.948085 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:02.953852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:02.956396 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:02.959329 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:03.031961 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:03.038737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.104047 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:38:03.104047 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:38:03.104263 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:03.104470 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:03.127171 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updated VIF entry in instance network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:38:03.127171 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:03.190675 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c969f8c1275340d3b8a0bbcb62a497ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e394a2d53341d59d512810b2a3dea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:38:03.203795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.211556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.214446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.241345 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.246967 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.249044 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:03.249265 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'resources' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:03.434745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.607113 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:38:03.629201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:03.629810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-changed-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:03.630015 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing instance network info cache due to event network-changed-9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:03.630207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquiring lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:03.630360 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquired lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:03.630538 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Refreshing network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:03.672235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-df45e599-4d74-4796-9c3f-6c26958bd00f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.184s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:03.673954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:03.674304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:03.674501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:03.674708 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:03.677213 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Terminating instance
May 14 03:38:03.702999 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:03.710245 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Successfully created port: 2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:38:03.713294 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 646c78c0-bf19-4d90-80ed-e79836dc0ecf due to new event <LifecycleEvent: 1778729883.7102406, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:38:03.713497 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729883.7102406, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:03.713739 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Resumed (Lifecycle Event)
May 14 03:38:03.715280 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:03.715944 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2184e711-dc5d-4079-b4fa-914c9a60d85b tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:03.718275 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:03.718275 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:03.735866 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:03.735866 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.744664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.752547 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:03.753600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:03.753600 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:03.754226 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:03.754451 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:03.756256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.757027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.758115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3244b2-8c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:03.759790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.760179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:03.762336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.764434 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:03.764713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13c55514-aedf-41b6-b949-47a7ad5fe35a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:03.765331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.765331 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.765331 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.765331 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.765331 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:03.766871 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.766871 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.766871 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.766871 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.766871 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:03.767920 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:03.770261 np0000000741 nova-compute[97948]: INFO os_vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:38:03.775337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start _get_guest_xml network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:03.778413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.778413 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.778413 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.778413 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.778413 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:03.778657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.778657 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.778657 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.778657 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.778657 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:03.780549 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:03.781084 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1243629956', uuid='7d8e14e9-c419-444d-9a38-73b5f8f65cba'), owner=OwnerMeta(userid='03f07c927d2143d2961164592bd62449', username='tempest-AttachVolumeTestJSON-1091031368-project-member', projectid='3492928cd5f64475bf5572822120dbbc', projectname='tempest-AttachVolumeTestJSON-1091031368'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729883.7806807) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:03.782352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:03.782803 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:03.784373 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:03.785186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:03.786022 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:03.788026 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:03.788229 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:03.788229 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:03.788422 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:03.788563 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:03.788737 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:03.788963 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:03.790061 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:03.790703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:03.790863 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:03.791008 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:03.791207 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:03.802193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:38:03.802193 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:38:03.802193 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.815106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.821401 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:38:03.821401 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:38:03.821401 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.831590 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.831865 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:03.832390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:03.832390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:03.833091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('7', '-', '-', 0) found on session 69 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:03.833220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:03.839807 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:03.860412 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:03.860412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:03.861521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('8', '-', '-', 0) found on session 70 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:03.861521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:03.866967 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:03.867098 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:03.867221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:03.867343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:03.868488 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:03.873715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 69 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:03.874458 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-unplugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state None.
May 14 03:38:03.874840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:03.876187 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:03.877160 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:03.877316 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:03.877397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:03.877572 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:03.877750 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state None.
May 14 03:38:03.877831 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:03.877971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:03.878121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:03.878225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:03.878336 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] No waiting events found dispatching network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:03.878503 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received unexpected event network-vif-plugged-9acf5057-6375-40ad-b805-32e6e0890442 for instance with vm_state active and task_state None.
May 14 03:38:03.878603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-deleted-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:03.883250 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Neutron deleted interface 823bc695-29a1-4bb8-bf76-ce875e310182; detaching it from the instance and deleting it from the info cache
May 14 03:38:03.883250 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:03.883250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 70 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:03.883494 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:03.893873 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:04.110709 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:38:04.133091 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:04.181104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:04.210920 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.222600 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:04.231092 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:04.232319 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.236381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.264168 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.297839 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:04.314780 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:04.317350 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:04.317350 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:04.317350 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:04.370141 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Successfully updated port: 2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:38:04.388857 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c4aa0dd-b2d2-46b6-841a-6a21a6a9e104 req-b4f50093-bc16-44aa-9026-8df2224f9598 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Detach interface failed, port_id=823bc695-29a1-4bb8-bf76-ce875e310182, reason: Instance 3273e916-e64e-40be-acfc-17ecdfb15f04 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:38:04.396148 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Took 1.45 seconds to deallocate network for instance.
May 14 03:38:04.436320 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-changed-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:04.436536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Refreshing instance network info cache due to event network-changed-2be556a8-b19b-4ddf-812e-c0f027583c01. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:04.436589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] Acquiring lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:04.437297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] Acquired lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:04.438355 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Refreshing network info cache for port 2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:04.446343 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:04.501993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.550140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.551402 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Instance destroyed successfully.
May 14 03:38:04.551568 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'resources' on Instance uuid c1690ab4-3a36-4896-a922-ab421f9fc8cb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:04.560521 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:04.569190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.606038 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:04.677044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:38:04.733064 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729884.732204, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:04.733265 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Started (Lifecycle Event)
May 14 03:38:04.763390 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updated VIF entry in instance network info cache for port 9acf5057-6375-40ad-b805-32e6e0890442. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:38:04.763390 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [{"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:04.768956 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:04.819822 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:04.821267 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <uuid>7d8e14e9-c419-444d-9a38-73b5f8f65cba</uuid>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <name>instance-00000011</name>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeTestJSON-server-1243629956</nova:name>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:03</nova:creationTime>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:user uuid="03f07c927d2143d2961164592bd62449">tempest-AttachVolumeTestJSON-1091031368-project-member</nova:user>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:project uuid="3492928cd5f64475bf5572822120dbbc">tempest-AttachVolumeTestJSON-1091031368</nova:project>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         <nova:port uuid="1b3244b2-8c49-400e-a1bf-35efd21b792a">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="serial">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="uuid">7d8e14e9-c419-444d-9a38-73b5f8f65cba</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk.config"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0a:fd:77"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <target dev="tap1b3244b2-8c"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/console.log" append="off"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:04.821267 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:04.824270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:04.851925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.860131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.861911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.873533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:04.894137 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:04.925037 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:04.928229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:04.954152 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:38:04.960379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Deleting volume: 5fc43301-192c-4b7f-a57b-89793b9f9364 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:38:05.029001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.054704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1136017',display_name='tempest-VolumesSnapshotTestJSON-instance-1136017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1136017',id=20,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYw28dTjd64EBoK7mo9VNJGKWI0fhQ9GpOoflIfK4XynsVwnWyy38hHOYL5lsCausN+vPQIqx6zRmHVJzb0vmR2AvgGY14IoQnzGr0j8kqGgXIQWTRxKxmo/oJXurUYfg==',key_name='tempest-keypair-806887781',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-di1zo53a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=c1690ab4-3a36-4896-a922-ab421f9fc8cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:05.056349 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "7ea71dcc-3436-473c-936d-1879902e6ccf", "address": "fa:16:3e:e6:0b:07", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea71dcc-34", "ovs_interfaceid": "7ea71dcc-3436-473c-936d-1879902e6ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:05.057684 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:05.058008 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:05.061194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.061194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.061194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ea71dcc-34, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:05.062381 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:05.066413 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:05.066485 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.067997 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.068195 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6595f45e-1730-4ed9-bfbb-e676a1086673) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:05.069058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.070022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:05.072682 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:05.074355 np0000000741 nova-compute[97948]: INFO os_vif [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:0b:07,bridge_name='br-int',has_traffic_filtering=True,id=7ea71dcc-3436-473c-936d-1879902e6ccf,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea71dcc-34')
May 14 03:38:05.077779 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:05.078511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:05.078511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:05.124813 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:38:05.126004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:38:05.126230 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Creating image(s)
May 14 03:38:05.127298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.127673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.128301 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.129753 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:05.137140 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:05.138478 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.238525 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:05.241934 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:05.257763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.262576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.262576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.262576 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:05.267196 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:05.268000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.268657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Releasing lock "refresh_cache-646c78c0-bf19-4d90-80ed-e79836dc0ecf" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:05.268865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.269081 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.269249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.269353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.269441 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.269629 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:05.269761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.269796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Acquiring lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.269920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.270055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.270273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] No waiting events found dispatching network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.270273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-00dd3a60-4fd0-4dd8-b49b-7ba919393e25 req-da8df75e-b92b-4ec1-aea2-72fb7e5b40c8 service nova] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Received event network-vif-unplugged-823bc695-29a1-4bb8-bf76-ce875e310182 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:05.285860 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-acd7dfbc-a5cd-4c37-a2d1-1e1afcfcecd9 req-727ba0f1-3724-4b64-9288-8a28e2d79c57 service nova] Releasing lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:05.287121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquired lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:05.287388 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:05.367982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.371132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.417369 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk 1073741824" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.418205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.418744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.507870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.508742 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:05.509220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.524687 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.525194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.567945 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:05.568542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.616958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Cannot resize image /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Ensure instance console log exists: /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.619282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.665732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.666088 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:05.666358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:05.701719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Found WWN 3300000003fbc00ed for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:38:05.703809 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:05.705066 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:05.705280 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:38:05.706203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.626s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:05.706577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae87b32e-5417-4eb4-b1f5-64c55a34b271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:05.706800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:05.709313 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'flavor' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:05.739827 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:05.740144 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:05.740443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '70')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:05.740657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:05.741169 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:38:05.741377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:05.741601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae87b32e-5417-4eb4-b1f5-64c55a34b271') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:38:05.741866 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01df560>, {}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:05.742105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Disconnecting from: [] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:05.742422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:05.742613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== disconnect_volume: return (663ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:05.742847 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:05.743555 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Deleting instance files /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb_del
May 14 03:38:05.746559 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Deletion of /opt/stack/data/nova/instances/c1690ab4-3a36-4896-a922-ab421f9fc8cb_del complete
May 14 03:38:05.751070 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.995936366000024 future=<Future at 0x79d09074bce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:05.772995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:05.773334 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Cannot resize image /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:05.773552 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'migration_context' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:05.871174 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:05.942132 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.942413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.942561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.946084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.946398 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.946662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:05.946805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.946985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.947134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.947257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.947379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.947523 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received unexpected event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with vm_state active and task_state deleting.
May 14 03:38:05.947688 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.947827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.947962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.948072 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.948186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.948302 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received unexpected event network-vif-plugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with vm_state active and task_state deleting.
May 14 03:38:05.948416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.948564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.948722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.948839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.948955 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.949070 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:05.949185 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:05.949305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Acquiring lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:05.949432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:05.949550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:05.949805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] No waiting events found dispatching network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:05.950227 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0503cd0c-83b2-4ed8-b815-835ece81a72f req-96c391ef-d521-4cb9-ac91-ccc3b8318692 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-unplugged-7ea71dcc-3436-473c-936d-1879902e6ccf for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:06.060839 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:06.170520 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:06.170857 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:06.221295 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attempting to attach volume e2431725-eb78-4c32-9d4e-a2f5b07187c7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:38:06.224017 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:   <alias name="ua-e2431725-eb78-4c32-9d4e-a2f5b07187c7"/>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:   <serial>e2431725-eb78-4c32-9d4e-a2f5b07187c7</serial>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:06.224017 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:38:06.241817 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updating instance_info_cache with network_info: [{"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:06.257498 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Took 2.08 seconds to destroy the instance on the hypervisor.
May 14 03:38:06.258399 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:06.259943 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:06.259943 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:06.259943 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:06.279369 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Object Instance<7d8e14e9-c419-444d-9a38-73b5f8f65cba> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:06.279369 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:06.279369 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:06.279369 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:06.279369 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:06.280360 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.280689 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:06.280949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:06.281776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.281917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2464d8f-4f72-5b72-8b00-327620658182', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:06.282963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.284291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:06.286180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.286310 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3244b2-8c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:06.286743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b3244b2-8c, col_values=(('qos', UUID('2163168a-ea50-4533-b05c-b79f9654d614')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:06.286950 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b3244b2-8c, col_values=(('external_ids', {'iface-id': '1b3244b2-8c49-400e-a1bf-35efd21b792a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fd:77', 'vm-uuid': '7d8e14e9-c419-444d-9a38-73b5f8f65cba'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:06.288084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.289152 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:06.294532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.295799 np0000000741 nova-compute[97948]: INFO os_vif [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:38:06.334098 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:06.674119 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:06.743982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Releasing lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:06.744479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance network_info: |[{"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:38:06.749952 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Start _get_guest_xml network_info=[{"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:06.759268 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:06.760506 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1619237265', uuid='a651c0b4-1267-4e3f-b151-7de64dd9e629'), owner=OwnerMeta(userid='c969f8c1275340d3b8a0bbcb62a497ed', username='tempest-VolumesBackupsTest-645442672-project-member', projectid='20e394a2d53341d59d512810b2a3dea2', projectname='tempest-VolumesBackupsTest-645442672'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729886.7601435) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:06.761755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:06.762162 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:06.763092 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:06.763259 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:06.764295 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:06.764653 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:06.764804 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:06.766692 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:06.766908 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:06.767020 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:06.767404 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:06.767692 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:06.767878 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:06.768131 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:06.768287 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:06.768450 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:06.778318 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1619237265',display_name='tempest-VolumesBackupsTest-instance-1619237265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1619237265',id=25,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjV5jRKTvzn+Ps9WhLG8hkh+ZPmN9afzpwylKxykfHIM602vqCYYJdL6JR/lovL/RcYQWVzvas4fF/3jxLWlHQ8JpTjXus509ErlqzfwDOYZYugEQyGmiI7HieFsWozuw==',key_name='tempest-keypair-558955526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-qr8hj4et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=a651c0b4-1267-4e3f-b151-7de64dd9e629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:06.778609 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:06.779070 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:06.779732 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'pci_devices' on Instance uuid a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:06.855769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.886041 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:06.901504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8a2fada9-91f3-4412-b6e7-27c27ce4d959 req-d882d374-54df-499f-bf72-8587db428b33 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Received event network-vif-deleted-7ea71dcc-3436-473c-936d-1879902e6ccf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:06.902043 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-8a2fada9-91f3-4412-b6e7-27c27ce4d959 req-d882d374-54df-499f-bf72-8587db428b33 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Neutron deleted interface 7ea71dcc-3436-473c-936d-1879902e6ccf; detaching it from the instance and deleting it from the info cache
May 14 03:38:06.902171 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8a2fada9-91f3-4412-b6e7-27c27ce4d959 req-d882d374-54df-499f-bf72-8587db428b33 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:06.991252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.184066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.659s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:07.192697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.196359 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.222316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.224162 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.235650 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Deleted allocations for instance 3273e916-e64e-40be-acfc-17ecdfb15f04
May 14 03:38:07.285247 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <uuid>a651c0b4-1267-4e3f-b151-7de64dd9e629</uuid>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <name>instance-00000019</name>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesBackupsTest-instance-1619237265</nova:name>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:06</nova:creationTime>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:user uuid="c969f8c1275340d3b8a0bbcb62a497ed">tempest-VolumesBackupsTest-645442672-project-member</nova:user>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:project uuid="20e394a2d53341d59d512810b2a3dea2">tempest-VolumesBackupsTest-645442672</nova:project>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         <nova:port uuid="2be556a8-b19b-4ddf-812e-c0f027583c01">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="serial">a651c0b4-1267-4e3f-b151-7de64dd9e629</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="uuid">a651c0b4-1267-4e3f-b151-7de64dd9e629</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.config"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5a:c5:d2"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <target dev="tap2be556a8-b1"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/console.log" append="off"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:07.285247 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Preparing to wait for external event network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1619237265',display_name='tempest-VolumesBackupsTest-instance-1619237265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1619237265',id=25,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjV5jRKTvzn+Ps9WhLG8hkh+ZPmN9afzpwylKxykfHIM602vqCYYJdL6JR/lovL/RcYQWVzvas4fF/3jxLWlHQ8JpTjXus509ErlqzfwDOYZYugEQyGmiI7HieFsWozuw==',key_name='tempest-keypair-558955526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-qr8hj4et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=a651c0b4-1267-4e3f-b151-7de64dd9e629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:07.287407 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:07.287758 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.287758 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:07.287931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:07.289151 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.289297 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21e2e574-55d3-5bce-bc33-aa6a610586d2', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:07.289960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.290827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:07.292056 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.294180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.294298 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2be556a8-b1, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:07.294578 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2be556a8-b1, col_values=(('qos', UUID('b7886eed-8298-413c-90ff-e9d423a1a418')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:07.294830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2be556a8-b1, col_values=(('external_ids', {'iface-id': '2be556a8-b19b-4ddf-812e-c0f027583c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:c5:d2', 'vm-uuid': 'a651c0b4-1267-4e3f-b151-7de64dd9e629'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:07.297871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:07.302686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:07.303976 np0000000741 nova-compute[97948]: INFO os_vif [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1')
May 14 03:38:07.311887 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:07.407848 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8a2fada9-91f3-4412-b6e7-27c27ce4d959 req-d882d374-54df-499f-bf72-8587db428b33 service nova] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Detach interface failed, port_id=7ea71dcc-3436-473c-936d-1879902e6ccf, reason: Instance c1690ab4-3a36-4896-a922-ab421f9fc8cb could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:38:07.806273 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 7d8e14e9-c419-444d-9a38-73b5f8f65cba due to new event <LifecycleEvent: 1778729887.8059266, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:38:07.806825 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729887.8059266, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:07.806825 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Resumed (Lifecycle Event)
May 14 03:38:07.809884 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:07.812692 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance rebooted successfully.
May 14 03:38:07.814400 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Took 1.56 seconds to deallocate network for instance.
May 14 03:38:07.840372 np0000000741 nova-compute[97948]: WARNING nova.volume.cinder [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Attachment f1be200a-65fe-481e-b91d-b39cc9da0ceb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f1be200a-65fe-481e-b91d-b39cc9da0ceb. (HTTP 404) (Request-ID: req-cdcb454f-a34d-45cf-8ca0-73943f8534b1)
May 14 03:38:07.840372 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Took 0.02 seconds to detach 1 volumes for instance.
May 14 03:38:07.912254 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:07.912461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:07.912692 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:07.913027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No VIF found with MAC fa:16:3e:fd:f9:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:08.246663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-90814cb5-eadf-401c-8e60-1c5727afaf2c tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3273e916-e64e-40be-acfc-17ecdfb15f04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.880s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:08.312119 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:08.313914 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:08.346756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:08.347742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:08.439217 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:08.816297 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:38:08.816813 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729888.8163967, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:08.816813 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Started (Lifecycle Event)
May 14 03:38:08.837499 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:08.838031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:08.838228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No VIF found with MAC fa:16:3e:5a:c5:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:08.839053 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Using config drive
May 14 03:38:08.957025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:08.957269 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:09.003695 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:09.009099 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-386455a2-8aeb-4bb5-83f8-86347c584f31 req-d0e97ae7-7834-4360-9be2-5f9f5b5c3f29 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state stopped and task_state powering-on.
May 14 03:38:09.318756 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:09.319980 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:09.328310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:09.328443 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:09.328570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:0a:fd:77, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:09.328914 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1642d9e5-a845-4f6e-b543-a796f9d0d506 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:09.347883 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:09.459824 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:09.486382 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-46742ae9-1900-4fb3-adf0-a333d8ff1d22 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.512s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:09.523071 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Creating config drive at /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.config
May 14 03:38:09.527310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg9qv_tyg {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:09.544040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:09.544542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:09.544877 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:09.545835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:09.546043 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:09.553285 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Terminating instance
May 14 03:38:09.590104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg9qv_tyg" returned: 0 in 0.063s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:09.823045 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:38:09.968786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.621s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:10.053746 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Deleted allocations for instance c1690ab4-3a36-4896-a922-ab421f9fc8cb
May 14 03:38:10.060531 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:10.116194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.152012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.153352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.197089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.255412 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.293418 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.300070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.323408 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:10.326251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:10.327844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:10.328080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:10.328349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:10.328666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-484a615c-d123-4cd1-a36d-0e4bd3880a9f req-c3b85e32-d970-4f02-baaa-be41d90420e7 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:10.377466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.412551 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-306ffee6-9022-4870-a8d1-1f433a2aaecd req-089feca2-1ed9-4a73-855f-515c2c519924 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:10.412771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-306ffee6-9022-4870-a8d1-1f433a2aaecd req-089feca2-1ed9-4a73-855f-515c2c519924 service nova] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:10.412948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-306ffee6-9022-4870-a8d1-1f433a2aaecd req-089feca2-1ed9-4a73-855f-515c2c519924 service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:10.413119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-306ffee6-9022-4870-a8d1-1f433a2aaecd req-089feca2-1ed9-4a73-855f-515c2c519924 service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:10.413287 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-306ffee6-9022-4870-a8d1-1f433a2aaecd req-089feca2-1ed9-4a73-855f-515c2c519924 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Processing event network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:38:10.415123 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999757993999992 future=<Future at 0x79d0b0180980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:10.428533 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.429440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.436367 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Instance destroyed successfully.
May 14 03:38:10.437155 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid 3930430d-5864-4c8c-86ec-ccbbf21f2513 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:10.468190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.686086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.693097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.695412 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.726166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.940658 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1407162342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1407162342',id=21,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-nsnko0x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:11Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=3930430d-5864-4c8c-86ec-ccbbf21f2513,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:10.941193 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "address": "fa:16:3e:04:aa:6f", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76d984fa-85", "ovs_interfaceid": "76d984fa-85f7-496b-be37-e00fc37a3d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:10.945353 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:10.945798 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:10.953006 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.953532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76d984fa-85, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:10.956851 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.956851 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:10.958288 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.958543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87791d9e-c3c2-4874-bf28-50f58134f476) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:10.959586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.959652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:10.960235 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:10.968309 np0000000741 nova-compute[97948]: INFO os_vif [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=76d984fa-85f7-496b-be37-e00fc37a3d6c,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76d984fa-85')
May 14 03:38:10.968884 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Deleting instance files /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513_del
May 14 03:38:10.969758 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Deletion of /opt/stack/data/nova/instances/3930430d-5864-4c8c-86ec-ccbbf21f2513_del complete
May 14 03:38:10.977524 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:11.071996 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a3bbd45-6dd2-46e1-8177-2065c795d70f tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "c1690ab4-3a36-4896-a922-ab421f9fc8cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.398s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:11.148529 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:11.153962 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:11.357568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:11.361742 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729891.3579602, a651c0b4-1267-4e3f-b151-7de64dd9e629 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:11.361742 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] VM Started (Lifecycle Event)
May 14 03:38:11.362015 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:38:11.367101 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance spawned successfully.
May 14 03:38:11.367988 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:38:11.485867 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Took 1.43 seconds to destroy the instance on the hypervisor.
May 14 03:38:11.487054 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:11.487237 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:11.487328 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:11.487597 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:11.614363 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:11.816983 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Stashing vm_state: active {{(pid=97948) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 03:38:11.864029 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:11.872987 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:11.882733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:11.885417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:11.886169 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:11.886862 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:11.887223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:11.887858 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:12.379847 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:38:12.380379 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729892.3798976, a651c0b4-1267-4e3f-b151-7de64dd9e629 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:12.380379 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] VM Paused (Lifecycle Event)
May 14 03:38:12.381985 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:12.387207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.387207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.393672 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Took 7.27 seconds to spawn the instance on the hypervisor.
May 14 03:38:12.396146 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:12.419209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.419754 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.420056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.420201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.420409 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.420613 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:12.420927 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.421002 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.421134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.421245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.421587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.423996 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received unexpected event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with vm_state active and task_state deleting.
May 14 03:38:12.427179 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.427179 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.427368 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.427892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.427892 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.427892 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received unexpected event network-vif-plugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with vm_state active and task_state deleting.
May 14 03:38:12.427892 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.428049 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.428163 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.428330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.428512 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.430467 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:12.430601 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.430747 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Acquiring lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.430968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.431098 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.431528 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] No waiting events found dispatching network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.431528 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99f37e09-1ff0-4101-a8d1-13f7b74c5eb0 req-29d15a4b-658a-41a3-95db-c648451488f1 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-unplugged-76d984fa-85f7-496b-be37-e00fc37a3d6c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:12.489268 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.491084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:12.491084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:12.491084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:12.491084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] No waiting events found dispatching network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:12.491603 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received unexpected event network-vif-plugged-2be556a8-b19b-4ddf-812e-c0f027583c01 for instance with vm_state active and task_state None.
May 14 03:38:12.492060 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cd0fb2a-83d0-497d-8961-2abfffdda441 req-13e314e2-7abe-4482-b13b-1796873b4339 service nova] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Received event network-vif-deleted-76d984fa-85f7-496b-be37-e00fc37a3d6c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:12.571114 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003498769999623619 future=<Future at 0x79d0b04824b0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:12.571254 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:12.571333 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.144906729000013 future=<Future at 0x79d0b0481c40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:12.571380 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.144826581999951 future=<Future at 0x79d0b0481c40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:12.884453 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:12.886001 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Took 1.40 seconds to deallocate network for instance.
May 14 03:38:12.888091 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729892.8877716, a651c0b4-1267-4e3f-b151-7de64dd9e629 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:12.888304 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] VM Resumed (Lifecycle Event)
May 14 03:38:12.902155 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:38:12.902504 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Claim successful on node np0000000741
May 14 03:38:12.913470 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Took 13.03 seconds to build instance.
May 14 03:38:13.394138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:13.395159 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:13.397225 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:13.414587 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating resource usage from migration 7dca87d9-a3ac-4d49-b56d-770cca7ab232
May 14 03:38:13.417583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.541s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:13.437712 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:13.855516 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:13.855717 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:14.358593 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:14.504155 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-changed-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:14.505121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Refreshing instance network info cache due to event network-changed-2be556a8-b19b-4ddf-812e-c0f027583c01. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:14.505407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] Acquiring lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:14.505568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] Acquired lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:14.505835 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Refreshing network info cache for port 2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:14.778795 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:14.779269 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:38:14.867210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.480s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:14.867695 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Migrating
May 14 03:38:14.868069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.473s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:14.868258 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:14.868364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "compute-rpcapi-router" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:15.008421 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:15.371222 np0000000741 nova-compute[97948]: INFO nova.compute.rpcapi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 14 03:38:15.372240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "compute-rpcapi-router" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:15.372462 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:38:15.487206 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:15.492788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:15.492788 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:15.621775 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updated VIF entry in instance network info cache for port 2be556a8-b19b-4ddf-812e-c0f027583c01. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:38:15.622165 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updating instance_info_cache with network_info: [{"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:15.898200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:15.898200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:15.898200 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:15.960854 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:15.997668 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:16.124273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6d359934-e8ce-4246-b8a3-7a38bb6ea81d req-626fbb45-0422-4e19-880c-4fe85dbb58f2 service nova] Releasing lock "refresh_cache-a651c0b4-1267-4e3f-b151-7de64dd9e629" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:16.399778 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:16.504404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.637s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:16.565686 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Deleted allocations for instance 3930430d-5864-4c8c-86ec-ccbbf21f2513
May 14 03:38:16.716605 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00036870200005978404 future=<Future at 0x79d0b0481c40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.716987 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.716987 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.23370137500000965 future=<Future at 0x79d0b04645f0 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.716987 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.23358840700007022 future=<Future at 0x79d0b04645f0 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.716987 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.717174 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.029371977999972 future=<Future at 0x79d09074bce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.717174 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.029306176999853 future=<Future at 0x79d09074bce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:16.718385 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Emitting event <LifecycleEvent: 1778729881.7161343, 3273e916-e64e-40be-acfc-17ecdfb15f04 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:16.718973 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] VM Stopped (Lifecycle Event)
May 14 03:38:16.771689 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:16.938914 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:17.225151 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-43a4f9d4-ee3c-441f-9c12-01dc674decfe tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: 3273e916-e64e-40be-acfc-17ecdfb15f04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:17.445203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:17.584309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6c1a3741-f66f-4f37-ad72-10a52e296b63 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "3930430d-5864-4c8c-86ec-ccbbf21f2513" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:17.783116 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:17.783685 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:38:18.116154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:18.116380 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:18.116579 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:18.116784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:18.116916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:18.119039 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Terminating instance
May 14 03:38:18.440007 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.623680 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:18.651248 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.657566 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.680969 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.821922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.828168 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.842816 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:18.843332 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:18.843486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:18.843648 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:18.843809 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:18.843943 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f5e96525-1c78-43d2-a3e6-00812e4b180a req-51371b49-ee9a-46a2-ad28-c16cff60f204 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:18.945666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:18.964520 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Starting migrate_disk_and_power_off {{(pid=97948) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 03:38:18.968582 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999702240999795 future=<Future at 0x79d0b00cbd40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:18.978995 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Instance destroyed successfully.
May 14 03:38:18.978995 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid f06ca3e4-a0f1-48d5-99a3-16d877adef99 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:18.998577 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.008315 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.071922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.146408 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.163494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.190660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.203708 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:19.203933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:19.232170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.379424 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:19.379622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:19.379797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:19.379937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:19.380094 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:19.380230 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b602ed36-6cd0-4213-9c92-8a46608b98d4 req-a716246f-94eb-47e0-a488-ada594c1b871 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state active and task_state resize_migrating.
May 14 03:38:19.388632 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999216607000108 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:19.392873 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance destroyed successfully.
May 14 03:38:19.395733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:18Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:19.395733 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:19.395733 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:19.395733 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:19.399960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.400192 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fbba53-5f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:19.401520 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.402700 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:19.410104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.411117 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.411332 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=367ef13c-cdd9-4247-b8f0-f39d54b74de3) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:19.411916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.412425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:19.422927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.428532 np0000000741 nova-compute[97948]: INFO os_vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:38:19.430268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:19.431357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:19.431905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:19.432533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:19.433030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:19.433220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:19.451832 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.463391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:19.474989 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:19.475328 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:19.475765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '70')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:19.475765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '69')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:19.483039 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2101756012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-2101756012',id=18,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:40Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-hv6r7xmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:47Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=f06ca3e4-a0f1-48d5-99a3-16d877adef99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:19.483842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '70')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:19.484212 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "4152108d-8740-489b-ae2f-66c9ab88a526", "address": "fa:16:3e:24:34:56", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4152108d-87", "ovs_interfaceid": "4152108d-8740-489b-ae2f-66c9ab88a526", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:19.485039 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:19.485361 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:19.487441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.487807 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4152108d-87, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:19.489004 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.489879 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:19.491004 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.492818 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8177e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:19.495495 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.496149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:19.496757 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b923699e-99cb-467d-a879-478ff8f2f9dc) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:19.497596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flush multipath device 3300000003fbc00ed {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:19.498541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.499175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:19.500978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:19.503957 np0000000741 nova-compute[97948]: INFO os_vif [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:34:56,bridge_name='br-int',has_traffic_filtering=True,id=4152108d-8740-489b-ae2f-66c9ab88a526,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4152108d-87')
May 14 03:38:19.508281 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:19.509045 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:19.509045 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:19.533990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:19.585874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:19.639365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:19.639365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:19.639365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:19.655545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:19.655545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:19.668659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.703280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:38:19.703280 np0000000741 nova-compute[97948]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:38:19.703280 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.708411 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:38:19.726583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.741935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.779406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:38:19.779406 np0000000741 nova-compute[97948]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:38:19.779406 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.784481 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:19.784481 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:19.784899 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:19.785226 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:19.795319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:19.796360 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:19.796360 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== disconnect_volume: return (364ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:19.796360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:19.796819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.288s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:19.798186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7cf99b4-5a00-4acb-9757-5827b95dd477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:19.798647 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:19.810013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:19.844226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.844226 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.844226 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.844226 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.844226 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:19.844803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsi session list stdout=tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.844803 np0000000741 nova-compute[97948]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477 (non-flash)
May 14 03:38:19.844803 np0000000741 nova-compute[97948]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.844803 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:19.844803 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:19.844803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:19.845049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '42')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:19.847692 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477', '43')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:19.848712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b043a660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:19.850037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:19.851038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Flush multipath device 3300000008cf33e27 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:19.889768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:19.914607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:19.916783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:19.942174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:19.995206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:19.995607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:19.997033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:20.008612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:20.008612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:20.020302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.028242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:20.028678 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:38:20.029388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:20.047962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.40.100,3260]
May 14 03:38:20.047962 np0000000741 nova-compute[97948]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.40.100,3260] successful.
May 14 03:38:20.047962 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.063092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.075920 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.105253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.50.100,3260]
May 14 03:38:20.105253 np0000000741 nova-compute[97948]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b7cf99b4-5a00-4acb-9757-5827b95dd477, portal: 192.168.50.100,3260] successful.
May 14 03:38:20.105253 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.120774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:20.121192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:20.121370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] <== disconnect_volume: return (612ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:20.121487 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:20.121890 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Deleting instance files /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99_del
May 14 03:38:20.122382 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Deletion of /opt/stack/data/nova/instances/f06ca3e4-a0f1-48d5-99a3-16d877adef99_del complete
May 14 03:38:20.138935 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:20.139457 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk.config /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:20.194108 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk.config /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:20.194551 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk.info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:20.247918 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "cp -r /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_resize/disk.info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:20.292910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.292910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.292996 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.293123 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:38:20.295623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.295905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.300075 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:38:20.300434 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Claim successful on node np0000000741
May 14 03:38:20.635223 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Took 2.01 seconds to destroy the instance on the hypervisor.
May 14 03:38:20.636959 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:20.637348 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:20.637631 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:20.638034 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:20.748936 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0024890980000691343 future=<Future at 0x79d09074bce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:20.751817 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778729885.7463303, c1690ab4-3a36-4896-a922-ab421f9fc8cb => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:20.751817 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] VM Stopped (Lifecycle Event)
May 14 03:38:20.752577 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:20.752577 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.6624297399998795 future=<Future at 0x79d0b0180980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:20.752577 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.662309547999939 future=<Future at 0x79d0b0180980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:20.781890 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:20.938034 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:20.938460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.943321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.943602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.943890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:20.944187 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:20.944711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:20.945029 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.945447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.945610 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.945946 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:20.946177 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state deleting.
May 14 03:38:20.946711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:20.947372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.947372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.947372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.947372 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:20.947372 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received unexpected event network-vif-plugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with vm_state active and task_state deleting.
May 14 03:38:20.947606 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:20.947606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.947706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.947816 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.948006 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:20.948159 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:20.948313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:20.948491 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Acquiring lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:20.948657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:20.948813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:20.951460 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] No waiting events found dispatching network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:20.951635 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d2914494-479a-4a69-897a-0ee1e9e0654f req-c693f18e-6785-4e63-b1d8-187550241381 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-unplugged-4152108d-8740-489b-ae2f-66c9ab88a526 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:21.252979 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5e456cbd-077c-4b68-bca9-309fab820180 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: c1690ab4-3a36-4896-a922-ab421f9fc8cb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:21.345511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.416982 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:21.417498 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:21.453433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.454430 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.495992 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:21.496741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:21.496741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:21.496970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:21.497164 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:21.497379 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-c383d81c-732c-456a-b719-3e71d8571c67 req-ce61102f-2599-4d14-8479-2d21253109bb service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state active and task_state resize_migrating.
May 14 03:38:21.546978 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Port 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 binding to destination host np0000000741 is already ACTIVE {{(pid=97948) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 03:38:21.567386 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:21.571387 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.575773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.674682 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.675311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.777356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.777356 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:38:21.777356 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid 'f06ca3e4-a0f1-48d5-99a3-16d877adef99' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f06ca3e4-a0f1-48d5-99a3-16d877adef99' (instance-00000012)
May 14 03:38:21.779168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.877705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.878157 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:21.990199 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:21.994181 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.074850 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Took 1.44 seconds to deallocate network for instance.
May 14 03:38:22.089020 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:22.089020 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:22.091709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.095662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.192577 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.194772 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:38:22.197947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.304756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.305723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.406703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.414609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.496674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.499769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.559039 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:38:22.569806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:22.569921 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:22.570330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:22.593598 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:22.602745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.608360 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:22.611662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:22.656134 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Took 0.58 seconds to detach 1 volumes for instance.
May 14 03:38:22.661805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Deleting volume: b7cf99b4-5a00-4acb-9757-5827b95dd477 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:38:22.665884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:22.666317 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12903MB free_disk=73.14209365844727GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:38:22.666772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:22.688655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:22.688880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:23.004929 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cd998d4c-a0fa-451a-bbd1-1429623e51f8 req-93fe2ac4-883d-4126-bab1-ae39f4dd6a72 service nova] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Received event network-vif-deleted-4152108d-8740-489b-ae2f-66c9ab88a526 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:23.105096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.809s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:23.106148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.439s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:23.107167 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:38:23.191740 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:38:23.218821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:23.461138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:23.584730 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:23.624088 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:38:23.624293 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:38:23.624581 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:23.624868 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:23.703594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:23.703732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:23.703858 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:23.711314 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cab6a4d716840acaf09bbecaaa536d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4aa2dbc46bc4fd7bb84c997a0a07ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:38:23.785817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:24.124925 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Applying migration context for instance 571defbc-9543-4887-939b-0ad9b4067a4f as it has an incoming, in-progress migration 7dca87d9-a3ac-4d49-b56d-770cca7ab232. Migration status is post-migrating {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 14 03:38:24.128137 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating resource usage from migration 7dca87d9-a3ac-4d49-b56d-770cca7ab232
May 14 03:38:24.138117 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:38:24.202532 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 42a1f2e8-804b-4703-ad8d-4ecf57fe737a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.202693 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.202882 np0000000741 nova-compute[97948]: WARNING nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f06ca3e4-a0f1-48d5-99a3-16d877adef99 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 14 03:38:24.203001 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.203132 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d2a0afdf-49df-42a9-b430-11871f7a16ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.203268 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a651c0b4-1267-4e3f-b151-7de64dd9e629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.203393 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Migration 7dca87d9-a3ac-4d49-b56d-770cca7ab232 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 03:38:24.203512 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 571defbc-9543-4887-939b-0ad9b4067a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.203654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:38:24.211996 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:24.328350 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Successfully created port: 72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:38:24.498245 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:24.631461 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:24.647027 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:38:24.706374 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 98331717-bd7f-486b-ad83-228f6b5e44b0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 03:38:24.706569 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:38:24.706698 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2112MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:38:22 up 30 min,  2 users,  load average: 8.02, 6.67, 3.47\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_6177683ef84349e5a26042f334b26ddd': '1', 'io_workload': '1', 'num_proj_3492928cd5f64475bf5572822120dbbc': '1', 'num_proj_203276d61c614abaab90c3d9d6e99e0e': '1', 'num_task_resize_migrated': '1', 'num_proj_97e6a6a9723c40a3bab2a058ab67df9f': '1', 'num_proj_37a8404c7d33468cab5b1fb42b63d221': '1', 'num_proj_20e394a2d53341d59d512810b2a3dea2': '1', 'num_vm_building': '1', 'num_proj_e4aa2dbc46bc4fd7bb84c997a0a07ac9': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:38:24.833036 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:24.868955 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Successfully updated port: 72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:38:24.966346 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-changed-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:24.966596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Refreshing instance network info cache due to event network-changed-72681560-8897-42b7-9d0e-88fa09dd982c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:24.966852 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] Acquiring lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:24.966991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] Acquired lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:24.967156 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Refreshing network info cache for port 72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:25.229088 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:25.229678 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:25.335031 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:25.371132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:25.415325 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004027449999739474 future=<Future at 0x79d0b0180980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:25.415870 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Emitting event <LifecycleEvent: 1778729890.4147868, 3930430d-5864-4c8c-86ec-ccbbf21f2513 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:25.416020 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:25.416235 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] VM Stopped (Lifecycle Event)
May 14 03:38:25.417226 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.551056389999985 future=<Future at 0x79d0b00cbd40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:25.417317 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.550919136999937 future=<Future at 0x79d0b00cbd40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:25.471016 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:25.567039 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:25.657269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:38:25.658667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:38:25.658948 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Creating image(s)
May 14 03:38:25.659979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:25.659979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:25.660481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:25.662202 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:25.666501 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:25.668578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:25.733418 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:25.750625 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:25.754026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:25.754673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:25.754986 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:25.755482 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:25.759604 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:25.759904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:25.847819 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:25.855433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:25.856286 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:25.873316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:38:25.895832 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:25.915172 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk 1073741824" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:25.918338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:25.918338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:25.928502 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-58f297e1-3809-4e95-9a3c-148e08ea0661 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 3930430d-5864-4c8c-86ec-ccbbf21f2513] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:25.940482 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:38:25.940898 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:38:25.952462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:38:25.953742 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe6e:ee72', 'fe80::641d:51ff:fe3d:1050', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe21:f62f', 'fe80::1c26:a8ff:fe0b:22b9', 'fe80::fc16:3eff:fe0a:fd77', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772'] 
May 14 03:38:25.953918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:38:25.954076 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:38:25.954437 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:26.011552 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:26.011933 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:26.012163 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:26.096834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:26.097227 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Cannot resize image /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:26.097760 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:38:26.097915 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Ensure instance console log exists: /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:38:26.098202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:26.098372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:26.098498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:26.248498 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:38:26.248977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:26.249442 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.030s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:26.249961 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:38:26.251393 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:26.254467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.466s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:26.254782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-963780a7-9957-48b3-9a42-675035997587 req-64a2e7c0-1cb2-4ce9-ad56-2dfb8e187e47 service nova] Releasing lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:26.257275 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquired lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:26.258189 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:26.263042 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:38:26.263207 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Claim successful on node np0000000741
May 14 03:38:26.329905 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Deleted allocations for instance f06ca3e4-a0f1-48d5-99a3-16d877adef99
May 14 03:38:26.853667 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:27.011345 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:27.106676 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Starting finish_migration {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 03:38:27.106676 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:38:27.106676 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Creating image(s)
May 14 03:38:27.106676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:27.185575 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating instance_info_cache with network_info: [{"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:27.203658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:27.203953 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:27.204189 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:27.248550 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:27.249095 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:27.249439 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:38:27.249660 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:38:27.250002 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.53 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:38:27.281348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:27.281693 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Cannot resize image /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:27.344972 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8bc522f7-ba48-40f0-ab6d-0b46b68b602e tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "f06ca3e4-a0f1-48d5-99a3-16d877adef99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.229s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:27.688985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Releasing lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:27.689481 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance network_info: |[{"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:38:27.692390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Start _get_guest_xml network_info=[{"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:27.695590 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:27.697598 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1591187327', uuid='0a1da0b4-8ee8-47f4-bea2-cff35980e148'), owner=OwnerMeta(userid='0cab6a4d716840acaf09bbecaaa536d4', username='tempest-VolumesSnapshotTestJSON-1729950457-project-member', projectid='e4aa2dbc46bc4fd7bb84c997a0a07ac9', projectname='tempest-VolumesSnapshotTestJSON-1729950457'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729907.697168) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:27.699482 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:27.699940 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:27.701051 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:27.701704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:27.703733 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:27.706703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:27.717106 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1591187327',display_name='tempest-VolumesSnapshotTestJSON-instance-1591187327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1591187327',id=26,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX2luR7nvt9GsbUijJ0ubCPBRglY3B1tnFmyvT/JVG2A5+iR8VPCJL5PPLxURlN5L4KQyAyefmgpCetazr7B7fW+jAu/l6bIElwKizzLzGMAV+N2w+/DnP+3nhc60CLTQ==',key_name='tempest-keypair-465312200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-y7tqg3ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=0a1da0b4-8ee8-47f4-bea2-cff35980e148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:27.717458 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:27.718331 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:27.719268 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:27.786497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:38:27.786497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Ensure instance console log exists: /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:38:27.786497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:27.786497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:27.786497 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:27.789917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start _get_guest_xml network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '571defbc-9543-4887-939b-0ad9b4067a4f', 'attached_at': '2026-05-14T03:38:26.000000', 'detached_at': '', 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'serial': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7'}, 'boot_index': None, 'attachment_id': '90350404-7376-4759-a2ec-e92965645173', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:27.794570 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:27.796212 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1378982848', uuid='571defbc-9543-4887-939b-0ad9b4067a4f'), owner=OwnerMeta(userid='51351b66a80d4223ab08bdc7a8aa2e57', username='tempest-ServerActionsTestOtherB-1843754337-project-member', projectid='97e6a6a9723c40a3bab2a058ab67df9f', projectname='tempest-ServerActionsTestOtherB-1843754337'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729907.7958362) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:27.801149 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:27.801920 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:27.804231 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:27.804888 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:27.805152 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:27.809522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:27.810481 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:27.812715 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:27.813145 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:27.833675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:27.920463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:27.922732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:27.922732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:27.922732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:27.923337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:38:27.923992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:27.924341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:27.924886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:27.925312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:38:27.940565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:27.941476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:27.942312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:27.942719 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:27.944514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:27.946372 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:27.955163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:27.955163 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:27.965679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:27.965679 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:27.974056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:27.974056 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:27.974056 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:27.974056 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:27.974056 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:27.974056 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:27.974056 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:27.974289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:27.974423 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:27.974565 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:27.981685 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:27.981685 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:27.981685 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:27.981685 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:27.981685 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:27.981685 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:27.981685 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:27.982044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:27.982044 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:27.982168 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:28.163728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:28.163896 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:28.164003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:28.164078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:28.164180 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:28.166617 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Terminating instance
May 14 03:38:28.223723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <uuid>0a1da0b4-8ee8-47f4-bea2-cff35980e148</uuid>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <name>instance-0000001a</name>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1591187327</nova:name>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:27</nova:creationTime>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:user uuid="0cab6a4d716840acaf09bbecaaa536d4">tempest-VolumesSnapshotTestJSON-1729950457-project-member</nova:user>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:project uuid="e4aa2dbc46bc4fd7bb84c997a0a07ac9">tempest-VolumesSnapshotTestJSON-1729950457</nova:project>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         <nova:port uuid="72681560-8897-42b7-9d0e-88fa09dd982c">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="serial">0a1da0b4-8ee8-47f4-bea2-cff35980e148</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="uuid">0a1da0b4-8ee8-47f4-bea2-cff35980e148</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.config"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5f:58:c9"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <target dev="tap72681560-88"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/console.log" append="off"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:28.223723 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Preparing to wait for external event network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1591187327',display_name='tempest-VolumesSnapshotTestJSON-instance-1591187327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1591187327',id=26,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX2luR7nvt9GsbUijJ0ubCPBRglY3B1tnFmyvT/JVG2A5+iR8VPCJL5PPLxURlN5L4KQyAyefmgpCetazr7B7fW+jAu/l6bIElwKizzLzGMAV+N2w+/DnP+3nhc60CLTQ==',key_name='tempest-keypair-465312200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-y7tqg3ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=0a1da0b4-8ee8-47f4-bea2-cff35980e148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:28.230800 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:28.231791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.232221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:28.232604 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:28.233762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.234020 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '339c9ac9-7798-59dd-b183-a098918785b8', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:28.234934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.236189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:28.237918 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.238153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72681560-88, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:28.238609 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72681560-88, col_values=(('qos', UUID('dacae246-ac77-445d-9a4a-db18b13ab3ef')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:28.238856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72681560-88, col_values=(('external_ids', {'iface-id': '72681560-8897-42b7-9d0e-88fa09dd982c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:58:c9', 'vm-uuid': '0a1da0b4-8ee8-47f4-bea2-cff35980e148'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:28.239742 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.241374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:28.246588 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.249321 np0000000741 nova-compute[97948]: INFO os_vif [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88')
May 14 03:38:28.314491 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:28.463069 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.669347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:28.694203 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.696456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.724166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.753575 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.754235 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:28.826540 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.575s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:28.827173 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:38:28.863489 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:28.865949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:28.865949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:28.865949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:28.865949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] No waiting events found dispatching network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:28.865949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e1e4109c-ec9d-4aca-b788-a12bbdef30e3 req-4c2e85fe-af91-4100-8261-13126bee52d3 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:28.975229 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:28.983196 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:28.990107 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:28.990107 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:29.000913 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:29.000913 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.012489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.016231 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999566983000022 future=<Future at 0x79d0b823a7e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:29.018123 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Instance destroyed successfully.
May 14 03:38:29.018800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.019274 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lazy-loading 'resources' on Instance uuid 42a1f2e8-804b-4703-ad8d-4ecf57fe737a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:29.026300 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.026300 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.026300 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:29.026534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.026534 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.026534 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:29.035835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.035835 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.035835 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:29.036342 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.036342 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.036342 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:29.065387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:38:29.065387 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:38:29.065387 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.081122 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.082507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:38:29.082507 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:38:29.082507 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.098538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:29.102427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.102427 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.102427 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.102427 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.102427 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.103070 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:29.103070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:29.103859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('7', '-', '-', 0) found on session 71 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:29.103951 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:29.112044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.112044 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.112044 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.112044 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.112044 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:29.112654 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:29.112654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:29.113221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('8', '-', '-', 0) found on session 72 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:29.113322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:29.123524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 71 and hctl ['7', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:29.132145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 72 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:29.132145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:29.333812 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:38:29.334603 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:38:29.334603 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:29.334885 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:29.424340 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71a50ef37e66489cbf8dc1dde0950769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a8404c7d33468cab5b1fb42b63d221', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:38:29.526850 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1033156099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverbootfromvolumestablerescuetest-server-1033156099',id=16,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:35:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6177683ef84349e5a26042f334b26ddd',ramdisk_id='',reservation_id='r-r67ofsql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-965770094',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:36:00Z,user_data=None,user_id='3fe2ffc6cce044f7ad75df57827bc19e',uuid=42a1f2e8-804b-4703-ad8d-4ecf57fe737a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:29.527058 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converting VIF {"id": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "address": "fa:16:3e:6e:ee:72", "network": {"id": "551a62f6-be17-4efd-aa8d-cccbcc41f4f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-551446960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6177683ef84349e5a26042f334b26ddd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1d49cf-c9", "ovs_interfaceid": "cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:29.527743 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:29.528067 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:29.530144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.530314 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf1d49cf-c9, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:29.537553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.538300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:29.544908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.546148 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.546405 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeff8230-076e-4e4e-89ae-1d96056e1f51) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:29.547719 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.548443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:29.553716 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:29.556194 np0000000741 nova-compute[97948]: INFO os_vif [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2,network=Network(551a62f6-be17-4efd-aa8d-cccbcc41f4f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1d49cf-c9')
May 14 03:38:29.556464 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Deleting instance files /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a_del
May 14 03:38:29.557224 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Deletion of /opt/stack/data/nova/instances/42a1f2e8-804b-4703-ad8d-4ecf57fe737a_del complete
May 14 03:38:29.768611 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:29.768815 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:29.768959 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No VIF found with MAC fa:16:3e:5f:58:c9, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:29.769542 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Using config drive
May 14 03:38:29.838832 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:38:29.894229 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Successfully created port: 25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:38:30.063274 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:38:30.064464 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:30.064898 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:30.065004 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:30.065243 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:30.122100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 71 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:30.122236 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:30.129242 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:30.276561 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:30.342226 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:38:30.478084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aba8b350-07b9-479a-b240-2f67ea4d51e9 req-e443a135-a7ae-4aab-8120-3811fb7fc28a service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-deleted-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:30.478335 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-aba8b350-07b9-479a-b240-2f67ea4d51e9 req-e443a135-a7ae-4aab-8120-3811fb7fc28a service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Neutron deleted interface cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2; detaching it from the instance and deleting it from the info cache
May 14 03:38:30.478507 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aba8b350-07b9-479a-b240-2f67ea4d51e9 req-e443a135-a7ae-4aab-8120-3811fb7fc28a service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:30.492274 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Successfully updated port: 25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:38:30.540792 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Creating config drive at /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.config
May 14 03:38:30.547566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjx9q8k95 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:30.601848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjx9q8k95" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:30.919446 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:30.942408 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:30.942659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Acquiring lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:30.942809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:30.942914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:30.943116 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] No waiting events found dispatching network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:30.943223 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Received event network-vif-unplugged-cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:30.943377 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-changed-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:30.943488 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Refreshing instance network info cache due to event network-changed-25eed01c-bba3-479b-af55-d34503546124. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:30.943659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Acquiring lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:30.943761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Acquired lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:30.943929 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Refreshing network info cache for port 25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:30.964527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Found WWN 3300000003fbc00ed for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:38:30.964969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:30.965200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:30.965365 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:38:30.983633 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aba8b350-07b9-479a-b240-2f67ea4d51e9 req-e443a135-a7ae-4aab-8120-3811fb7fc28a service nova] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Detach interface failed, port_id=cf1d49cf-c9fc-40b1-9317-b113b6f9c1b2, reason: Instance 42a1f2e8-804b-4703-ad8d-4ecf57fe737a could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:38:30.995105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:31.088357 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.121855 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.122761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.223552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.358202 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:38:31.358931 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:38:31.359251 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating image(s)
May 14 03:38:31.359999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:31.360260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:31.360735 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:31.363484 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:31.368374 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:31.369739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:31.423108 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Took 1.36 seconds to deallocate network for instance.
May 14 03:38:31.448785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.456301 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:31.460329 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.473973 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:18Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:31.474270 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:31.475225 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:31.481305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <uuid>571defbc-9543-4887-939b-0ad9b4067a4f</uuid>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <name>instance-00000016</name>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <memory>262144</memory>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherB-server-1378982848</nova:name>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:27</nova:creationTime>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.micro" id="84">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:memory>256</nova:memory>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:user uuid="51351b66a80d4223ab08bdc7a8aa2e57">tempest-ServerActionsTestOtherB-1843754337-project-member</nova:user>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:project uuid="97e6a6a9723c40a3bab2a058ab67df9f">tempest-ServerActionsTestOtherB-1843754337</nova:project>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         <nova:port uuid="30fbba53-5fb6-4c07-8fc5-9744ea6b8967">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="serial">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="uuid">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <alias name="ua-e2431725-eb78-4c32-9d4e-a2f5b07187c7"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <serial>e2431725-eb78-4c32-9d4e-a2f5b07187c7</serial>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:fd:f9:20"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <target dev="tap30fbba53-5f"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/console.log" append="off"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:31.481305 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:31.483730 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:18Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:31.483730 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1891144663-network", "vif_mac": "fa:16:3e:fd:f9:20"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:31.487156 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:31.487156 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:31.487156 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.487156 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:31.487156 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:31.490706 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.490706 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6735a810-25f4-516a-9033-1e52f702279c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:31.492741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.492741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:31.492741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.495630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.495830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fbba53-5f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:31.496227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30fbba53-5f, col_values=(('qos', UUID('2b251173-90bf-4bf8-8c62-d8cfe80556b4')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:31.496377 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30fbba53-5f, col_values=(('external_ids', {'iface-id': '30fbba53-5fb6-4c07-8fc5-9744ea6b8967', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:f9:20', 'vm-uuid': '571defbc-9543-4887-939b-0ad9b4067a4f'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:31.497857 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.498447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:31.505782 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:31.505782 np0000000741 nova-compute[97948]: INFO os_vif [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:38:31.514578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.145s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:31.517237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:31.517726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:31.520164 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:31.525557 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:31.526346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:31.558205 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:31.618523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:31.620179 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:31.678666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk 1073741824" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:31.679908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:31.683944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:31.763227 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:31.800570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:31.801141 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:31.801482 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:31.906654 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:31.906983 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Cannot resize image /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:31.907411 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:38:31.907604 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Ensure instance console log exists: /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:38:31.907905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:31.908175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:31.908320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:31.938869 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:31.939075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:32.015155 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729912.0146499, 0a1da0b4-8ee8-47f4-bea2-cff35980e148 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:32.015685 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] VM Started (Lifecycle Event)
May 14 03:38:32.266222 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f47ae4a-4071-4172-ba89-92065d06f320 req-e554dda3-5fa5-4abb-a7fa-59ce166bdf99 service nova] Releasing lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:32.267399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:32.267857 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:32.409235 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:32.409609 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:32.518863 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:32.523122 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729912.5228248, 0a1da0b4-8ee8-47f4-bea2-cff35980e148 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:32.524506 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] VM Paused (Lifecycle Event)
May 14 03:38:32.561402 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:32.561826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:32.561998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:32.562141 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:32.562341 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Processing event network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:38:32.562517 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:32.563259 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:32.566897 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:32.567132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:32.567273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:32.567429 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] No waiting events found dispatching network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:32.567553 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2b978cfa-510f-4a50-a250-1b0ab75a89a8 req-804bee2f-028e-4341-9bef-6195904cbebb service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received unexpected event network-vif-plugged-72681560-8897-42b7-9d0e-88fa09dd982c for instance with vm_state building and task_state spawning.
May 14 03:38:32.569757 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:38:32.571837 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance spawned successfully.
May 14 03:38:32.572226 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:38:32.849406 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:32.914852 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:33.021998 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:33.028438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:33.028603 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:33.028742 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:33.029527 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:33.029677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] No VIF found with MAC fa:16:3e:fd:f9:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:33.031274 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Using config drive
May 14 03:38:33.031411 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729913.0312128, 0a1da0b4-8ee8-47f4-bea2-cff35980e148 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:33.031582 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] VM Resumed (Lifecycle Event)
May 14 03:38:33.081977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.082120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.082446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.082656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.082955 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.083191 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:33.197179 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating instance_info_cache with network_info: [{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:33.426631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.487s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:33.465213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.473308 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Deleted allocations for instance 42a1f2e8-804b-4703-ad8d-4ecf57fe737a
May 14 03:38:33.508487 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.536495 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:33.538070 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:33.540162 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.595671 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Took 7.93 seconds to spawn the instance on the hypervisor.
May 14 03:38:33.595671 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:33.665735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.700527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:33.700877 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance network_info: |[{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:38:33.702816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start _get_guest_xml network_info=[{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:33.706124 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:33.707735 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1211408181', uuid='98331717-bd7f-486b-ad83-228f6b5e44b0'), owner=OwnerMeta(userid='71a50ef37e66489cbf8dc1dde0950769', username='tempest-ServerActionsTestOtherA-882285516-project-member', projectid='37a8404c7d33468cab5b1fb42b63d221', projectname='tempest-ServerActionsTestOtherA-882285516'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729913.7072325) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:33.711775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:33.712216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:33.713664 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:33.714115 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:33.715025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:33.715332 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:33.715507 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:33.715613 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:33.715749 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:33.715836 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:33.715933 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:33.716294 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:33.716294 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:33.716294 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:33.716416 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:33.716495 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:33.733767 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:33.734430 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:33.738166 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-tempest.common.compute-instance-1211408181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:33.738618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:33.738838 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:33.739884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:33.740037 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:33.741398 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:33.741398 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-79c5d8dc-91cc-4b79-986c-d7482f26f517 req-e4a1bb89-bb6c-4ee0-b9af-fc40be592a2e service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state active and task_state resize_finish.
May 14 03:38:33.741944 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'pci_devices' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:33.848958 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.853529 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.863458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.864672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.893367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:33.968826 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004915470001378708 future=<Future at 0x79d0b00cbd40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:33.969395 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Emitting event <LifecycleEvent: 1778729898.9681828, f06ca3e4-a0f1-48d5-99a3-16d877adef99 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:33.969585 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:33.970061 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] VM Stopped (Lifecycle Event)
May 14 03:38:33.970194 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.41703848000020116 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:33.970332 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.4168836360001933 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:34.046817 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:38:34.116791 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Took 13.89 seconds to build instance.
May 14 03:38:34.249413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <uuid>98331717-bd7f-486b-ad83-228f6b5e44b0</uuid>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <name>instance-0000001b</name>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:name>tempest-tempest.common.compute-instance-1211408181</nova:name>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:33</nova:creationTime>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:user uuid="71a50ef37e66489cbf8dc1dde0950769">tempest-ServerActionsTestOtherA-882285516-project-member</nova:user>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:project uuid="37a8404c7d33468cab5b1fb42b63d221">tempest-ServerActionsTestOtherA-882285516</nova:project>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         <nova:port uuid="25eed01c-bba3-479b-af55-d34503546124">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="serial">98331717-bd7f-486b-ad83-228f6b5e44b0</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="uuid">98331717-bd7f-486b-ad83-228f6b5e44b0</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:63:95:d2"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <target dev="tap25eed01c-bb"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/console.log" append="off"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:34.249413 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Preparing to wait for external event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-tempest.common.compute-instance-1211408181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:34.252140 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:34.252595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.253549 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:34.253549 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:34.253984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.254270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7859b11-1810-58ad-857f-601fa581ad35', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:34.267254 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.267858 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:34.269827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.272443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.272713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25eed01c-bb, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:34.273165 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25eed01c-bb, col_values=(('qos', UUID('ffe8371d-2d92-4769-b0fc-62167324550d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:34.273400 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25eed01c-bb, col_values=(('external_ids', {'iface-id': '25eed01c-bba3-479b-af55-d34503546124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:95:d2', 'vm-uuid': '98331717-bd7f-486b-ad83-228f6b5e44b0'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:34.274794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.276036 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:34.280546 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:34.282000 np0000000741 nova-compute[97948]: INFO os_vif [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb')
May 14 03:38:34.388433 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0010994539998137043 future=<Future at 0x79d0b0709100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:34.388595 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:34.388699 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.627034950999814 future=<Future at 0x79d0b823a7e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:34.390164 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.626957007999863 future=<Future at 0x79d0b823a7e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:34.390164 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778729899.3871508, 571defbc-9543-4887-939b-0ad9b4067a4f => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:34.390164 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Stopped (Lifecycle Event)
May 14 03:38:34.474619 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: f06ca3e4-a0f1-48d5-99a3-16d877adef99] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:34.482825 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0061cab4-316c-49ca-92c6-c43839cce174 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Lock "42a1f2e8-804b-4703-ad8d-4ecf57fe737a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.318s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:34.487919 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 571defbc-9543-4887-939b-0ad9b4067a4f due to new event <LifecycleEvent: 1778729914.4875684, 571defbc-9543-4887-939b-0ad9b4067a4f => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:38:34.488156 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729914.4875684, 571defbc-9543-4887-939b-0ad9b4067a4f => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:34.488287 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Resumed (Lifecycle Event)
May 14 03:38:34.492022 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:34.497166 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance running successfully.
May 14 03:38:34.498150 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Failed to set time: agent not configured {{(pid=97948) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 03:38:34.498299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b005287-b65a-4cec-be9f-3e4fd040799e tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] finish_migration finished successfully. {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 03:38:34.621250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e3d62fa-cdf6-4295-a3dd-2e2ce6ae24b9 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.417s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:34.892417 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:34.990547 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:34.992631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:35.048055 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-changed-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:35.048055 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Refreshing instance network info cache due to event network-changed-72681560-8897-42b7-9d0e-88fa09dd982c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:35.048055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] Acquiring lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:35.048172 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] Acquired lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:35.048503 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Refreshing network info cache for port 72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:35.496204 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:38:35.498563 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729915.4969893, 571defbc-9543-4887-939b-0ad9b4067a4f => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:35.498563 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Started (Lifecycle Event)
May 14 03:38:35.558486 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:35.799828 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:35.799828 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:35.799828 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:63:95:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:35.800110 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Using config drive
May 14 03:38:35.815690 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:35.816402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:35.816402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:35.816402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:35.816595 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:35.816940 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5cf69be7-2f43-40b5-9b49-11db706a8955 req-6c6c90d4-a0aa-486b-9dea-cba3be010aca service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state resized and task_state None.
May 14 03:38:35.929320 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:35.999932 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:36.001425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:36.090717 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updated VIF entry in instance network info cache for port 72681560-8897-42b7-9d0e-88fa09dd982c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:38:36.091009 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating instance_info_cache with network_info: [{"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:36.309190 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:36.471497 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating config drive at /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config
May 14 03:38:36.475348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp_3c72k4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:36.535361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp_3c72k4" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:36.594413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70bd58bf-c266-42e2-a8c6-a72c991acdd8 req-f7be4253-dd11-44d9-a44e-fd3b20ad7774 service nova] Releasing lock "refresh_cache-0a1da0b4-8ee8-47f4-bea2-cff35980e148" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:36.613866 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:36.702144 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:36.702431 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:36.702654 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:36.708795 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:36.903992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:36.904195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:37.053347 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:37.083079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:37.181336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:37.209263 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:37.210070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:37.368911 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Port 30fbba53-5fb6-4c07-8fc5-9744ea6b8967 binding to destination host np0000000741 is already ACTIVE {{(pid=97948) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 03:38:37.369261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:37.369310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:37.369449 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:37.407080 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Detaching volume 4ee06340-b4e7-4638-8043-b0bbc4dbe912
May 14 03:38:37.466463 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Attempting to driver detach volume 4ee06340-b4e7-4638-8043-b0bbc4dbe912 from mountpoint /dev/vdb
May 14 03:38:37.473579 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Found disk vdb by alias ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:38:37.475565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Found disk vdb by alias ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:38:37.475705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Attempting to detach device vdb from instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:38:37.476062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <alias name="ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912"/>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <serial>4ee06340-b4e7-4638-8043-b0bbc4dbe912</serial>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:37.476062 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:38:37.493204 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Successfully detached device vdb from instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf from the persistent domain config.
May 14 03:38:37.493408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] (1/8): Attempting to detach device vdb with device alias ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912 from instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:38:37.493709 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <alias name="ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912"/>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <serial>4ee06340-b4e7-4638-8043-b0bbc4dbe912</serial>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:37.493709 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:38:37.872854 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:37.881309 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:37.881533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:37.881738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:37.881884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:37.882051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Processing event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:38:37.882241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:37.883243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:37.883502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:37.883658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:37.885719 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:37.885719 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-ac45813f-0626-48eb-82bc-4010247dbb4e req-f5dfa40a-e2da-4a3b-a0b0-4bdd8627049e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received unexpected event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 for instance with vm_state building and task_state spawning.
May 14 03:38:38.003323 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729918.0028691, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:38.003493 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Started (Lifecycle Event)
May 14 03:38:38.006038 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:38.012503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:38:38.016279 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance spawned successfully.
May 14 03:38:38.016598 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:38:38.117622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912 for instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:38:38.259427 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:38.441321 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:38.469315 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:38.497686 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:38:38.506462 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:38.513271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:38.525501 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.525674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.526135 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.526542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.526973 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.527406 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:38:38.944606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:39.016736 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:38:39.017415 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729919.0171995, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:39.017570 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Paused (Lifecycle Event)
May 14 03:38:39.033835 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Took 7.68 seconds to spawn the instance on the hypervisor.
May 14 03:38:39.034110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:39.274660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:39.448062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Creating tmpfile /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/tmpurya5huh to verify with other compute node that the instance is on the same shared storage. {{(pid=97948) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 14 03:38:39.448446 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:38:39.521231 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:39.523185 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729919.5228713, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:39.523437 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Resumed (Lifecycle Event)
May 14 03:38:39.547072 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Took 15.85 seconds to build instance.
May 14 03:38:39.998889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.001949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.024945 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.029588 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:40.033968 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:40.035286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.049148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.360s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:40.061562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.245286 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:40.245729 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:40.246520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:40.246520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:40.246520 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:40.246520 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-29ad3b51-2862-4475-a291-d9422a1c18ba req-c3eafd01-8199-40ee-99c2-37ef878b3b8b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state resized and task_state resize_reverting.
May 14 03:38:40.300952 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.312082 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.338212 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance destroyed successfully.
May 14 03:38:40.338652 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'resources' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:40.538027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729920.5373328, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => ua-4ee06340-b4e7-4638-8043-b0bbc4dbe912> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:38:40.538027 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999808547000157 future=<Future at 0x79d0b81a2600 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:40.543376 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Successfully detached device vdb from instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf from the live domain config.
May 14 03:38:40.544414 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:40.545891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:40.546145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:40.546559 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:40.546924 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ee06340-b4e7-4638-8043-b0bbc4dbe912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:40.547067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:40.575821 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:40.575821 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:40.575821 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.575821 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.575821 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:40.576138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:40.576138 np0000000741 nova-compute[97948]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912 (non-flash)
May 14 03:38:40.576138 np0000000741 nova-compute[97948]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.576138 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.576138 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:40.576138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '72')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:40.576365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '64')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:40.577348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912', '65')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:40.577990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0458220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:40.581697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:40.581697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Flush multipath device 330000000e39064f3 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:40.620365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:40.672264 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:40.728291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:40.728498 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:40.729444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:40.744356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:40.744356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:40.758787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.761461 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.795924 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.40.100,3260]
May 14 03:38:40.795924 np0000000741 nova-compute[97948]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.40.100,3260] successful.
May 14 03:38:40.795924 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.811348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.825941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.842354 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:35Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:40.844660 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:40.844660 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:40.844660 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:40.846180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.846435 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fbba53-5f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:40.847497 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.850983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:40.852181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.852381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b251173-90bf-4bf8-8c62-d8cfe80556b4) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:40.855358 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:40.856220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.50.100,3260]
May 14 03:38:40.856220 np0000000741 nova-compute[97948]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4ee06340-b4e7-4638-8043-b0bbc4dbe912, portal: 192.168.50.100,3260] successful.
May 14 03:38:40.856220 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.857058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:40.859952 np0000000741 nova-compute[97948]: INFO os_vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:38:40.866666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:38:40.869265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:40.869265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:40.876083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:40.876083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:40.876083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] <== disconnect_volume: return (330ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:40.876083 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:40.876981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:40.878822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:38:40.878966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:38:40.905202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.905202 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.905202 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:40.905395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.905395 np0000000741 nova-compute[97948]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:40.905395 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:40.905587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '72')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:38:40.905691 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '71')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:40.906591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '72')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:38:40.907812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b82e6660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:38:40.907812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:38:40.908553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flush multipath device 3300000003fbc00ed {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:38:40.947823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:40.993371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:38:41.042374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:38:41.042747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:38:41.043389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:38:41.057288 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:38:41.057471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:38:41.070994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.097528 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:38:41.097528 np0000000741 nova-compute[97948]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:38:41.097528 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.112286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.132211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.168669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:38:41.168669 np0000000741 nova-compute[97948]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:38:41.168669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.180963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:41.181221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:41.181295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== disconnect_volume: return (312ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:41.181485 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:38:41.321893 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-changed-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:41.322059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Refreshing instance network info cache due to event network-changed-25eed01c-bba3-479b-af55-d34503546124. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:41.322148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] Acquiring lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:41.322277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] Acquired lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:41.322336 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Refreshing network info cache for port 25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:41.425039 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'flavor' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:41.831945 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:42.276253 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:42.351044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:42.351529 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:42.351713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:42.351820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:42.352010 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:42.352155 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2aab3194-a42d-4cbf-86fe-241e237b23e7 req-2e05bdc1-2de3-4511-b2c3-226aec663cc9 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state resized and task_state resize_reverting.
May 14 03:38:42.359320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:42.360072 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:42.434504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-680a8ff9-6da5-4335-bfb6-88c978a48e32 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.528s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:42.445954 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updated VIF entry in instance network info cache for port 25eed01c-bba3-479b-af55-d34503546124. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:38:42.446271 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating instance_info_cache with network_info: [{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:42.863176 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'migration_context' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:42.949019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d64be245-ead6-4ce4-8aa0-9c4d1a278b36 req-d824a3d7-748b-439b-8af1-570b81f53e2e service nova] Releasing lock "refresh_cache-98331717-bd7f-486b-ad83-228f6b5e44b0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:43.364692 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Object Instance<571defbc-9543-4887-939b-0ad9b4067a4f> lazy-loaded attributes: resources,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:38:43.484296 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:43.560242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:43.829329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:43.829609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:43.835268 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:43.835437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:43.835437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:43.839668 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Terminating instance
May 14 03:38:43.936927 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:43.937058 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003514740001264727 future=<Future at 0x79d0b823a7e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.521466412000109 future=<Future at 0x79d0b81a2600 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.521403245000101 future=<Future at 0x79d0b81a2600 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778729909.015676, 42a1f2e8-804b-4703-ad8d-4ecf57fe737a => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:44.017527 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] VM Stopped (Lifecycle Event)
May 14 03:38:44.341705 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:44.362349 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.364872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.389223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.391303 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.418439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.439936 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:44.519349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 42a1f2e8-804b-4703-ad8d-4ecf57fe737a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:44.651280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:44.674243 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999705707999965 future=<Future at 0x79d0b0742c00 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:44.675860 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Instance destroyed successfully.
May 14 03:38:44.676205 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lazy-loading 'resources' on Instance uuid 646c78c0-bf19-4d90-80ed-e79836dc0ecf {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:45.178446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2053616745',display_name='tempest-ServerStableDeviceRescueTest-server-2053616745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverstabledevicerescuetest-server-2053616745',id=19,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOehng1ilN6xqQk2M0LzjjdlGsdHiekcawpTfGWtNTCkZBR2H6IUvn/vOdjKk0dQxjkhax8hhlAK4q0kgWTk4/A46IvTm6uLKWVFxX2k0jchU58RoM6BWd+tZrVtbDN35w==',key_name='tempest-keypair-1256657895',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='203276d61c614abaab90c3d9d6e99e0e',ramdisk_id='',reservation_id='r-2hifa2g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1584222625',owner_user_name='tempest-ServerStableDeviceRescueTest-1584222625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c22726ed0c7244b6a428e2a6f49d9e07',uuid=646c78c0-bf19-4d90-80ed-e79836dc0ecf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:45.178688 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converting VIF {"id": "9acf5057-6375-40ad-b805-32e6e0890442", "address": "fa:16:3e:21:f6:2f", "network": {"id": "358723a5-314a-4f93-8113-910314703c61", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-470141405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "203276d61c614abaab90c3d9d6e99e0e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9acf5057-63", "ovs_interfaceid": "9acf5057-6375-40ad-b805-32e6e0890442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:45.179346 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:45.179543 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:45.180549 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:45.180917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9acf5057-63, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:45.183087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:45.183882 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:45.184591 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:45.184846 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=732d4d9c-a568-4a37-9846-1c2059e979bb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:45.185333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:45.186141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:45.188421 np0000000741 nova-compute[97948]: INFO os_vif [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:2f,bridge_name='br-int',has_traffic_filtering=True,id=9acf5057-6375-40ad-b805-32e6e0890442,network=Network(358723a5-314a-4f93-8113-910314703c61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9acf5057-63')
May 14 03:38:45.188818 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Deleting instance files /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf_del
May 14 03:38:45.189678 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Deletion of /opt/stack/data/nova/instances/646c78c0-bf19-4d90-80ed-e79836dc0ecf_del complete
May 14 03:38:45.454356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.094s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:45.454736 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:38:45.695387 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 03:38:45.695978 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:45.696277 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:45.696358 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:45.696573 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:45.752497 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:46.249887 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-adbc6857-ed4f-46a9-934b-5e25bc4051ff req-0c0a2762-5081-451b-9a1f-72702d14006a service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Received event network-vif-deleted-9acf5057-6375-40ad-b805-32e6e0890442 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:46.250108 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-adbc6857-ed4f-46a9-934b-5e25bc4051ff req-0c0a2762-5081-451b-9a1f-72702d14006a service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Neutron deleted interface 9acf5057-6375-40ad-b805-32e6e0890442; detaching it from the instance and deleting it from the info cache
May 14 03:38:46.250262 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-adbc6857-ed4f-46a9-934b-5e25bc4051ff req-0c0a2762-5081-451b-9a1f-72702d14006a service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:46.647370 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:46.648113 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:46.665053 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:46.754218 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-adbc6857-ed4f-46a9-934b-5e25bc4051ff req-0c0a2762-5081-451b-9a1f-72702d14006a service nova] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Detach interface failed, port_id=9acf5057-6375-40ad-b805-32e6e0890442, reason: Instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:38:47.040486 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Swapping old allocation on dict_keys(['2bd2dd56-bccc-4319-9878-49768bc97c10']) held by migration 7dca87d9-a3ac-4d49-b56d-770cca7ab232 for instance
May 14 03:38:47.123539 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Overwriting current allocation {'allocations': {'2bd2dd56-bccc-4319-9878-49768bc97c10': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': '97e6a6a9723c40a3bab2a058ab67df9f', 'user_id': '51351b66a80d4223ab08bdc7a8aa2e57', 'consumer_generation': 1} on consumer 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 14 03:38:47.149869 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:38:47.167259 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Took 1.47 seconds to deallocate network for instance.
May 14 03:38:47.231687 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:47.277057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:47.277259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:47.277440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:47.277576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:47.277713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:47.281158 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Terminating instance
May 14 03:38:47.332833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:47.333679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquired lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:47.333679 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:47.673665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:47.674178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:47.722012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:47.786898 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:38:47.806339 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:47.810480 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:47.837397 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:47.839318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:47.842180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:47.872665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.037770 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:48.037998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:48.038208 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:48.038387 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:48.038533 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:48.039388 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ececa365-9a8a-4830-9e49-05dc713f1540 req-9fee9de3-1b61-4a5d-ad21-6983e9070253 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:48.104420 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.133598 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.141929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.149332 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999672516999908 future=<Future at 0x79d0b0759370 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:48.150752 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Instance destroyed successfully.
May 14 03:38:48.151916 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'resources' on Instance uuid 7d8e14e9-c419-444d-9a38-73b5f8f65cba {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:48.166255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.184597 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:48.184851 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:48.318330 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:48.443266 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.454213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.459726 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.475285 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:48.482581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.490595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.600173 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.630389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.654425 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1243629956',display_name='tempest-AttachVolumeTestJSON-server-1243629956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1243629956',id=17,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlk3GcaOGY0d4YhYeXf5H7BOn32S9UHG9LwyIxZL4bhJVip6Gecjy0M70JBmT5vJkdpk8r+e4awLXSev6NkzfgTb3LX8kMYhOsWoAuuzGzXwyq5M+AJPiuWEsykPdLTXA==',key_name='tempest-keypair-701803028',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:36:06Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-5qtmb6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=7d8e14e9-c419-444d-9a38-73b5f8f65cba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:38:48.654680 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "address": "fa:16:3e:0a:fd:77", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3244b2-8c", "ovs_interfaceid": "1b3244b2-8c49-400e-a1bf-35efd21b792a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:48.655307 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:48.655586 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:38:48.658166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.658536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3244b2-8c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:48.660796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.662031 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:48.665069 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.665331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2163168a-ea50-4533-b05c-b79f9654d614) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:48.666671 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.666671 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:48.667838 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:48.672390 np0000000741 nova-compute[97948]: INFO os_vif [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:77,bridge_name='br-int',has_traffic_filtering=True,id=1b3244b2-8c49-400e-a1bf-35efd21b792a,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3244b2-8c')
May 14 03:38:48.672390 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Deleting instance files /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba_del
May 14 03:38:48.673506 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Deletion of /opt/stack/data/nova/instances/7d8e14e9-c419-444d-9a38-73b5f8f65cba_del complete
May 14 03:38:48.688095 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:48.977346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Releasing lock "refresh_cache-571defbc-9543-4887-939b-0ad9b4067a4f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:48.977767 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:48.987890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:38:49.009451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:49.055585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:38:49.055958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:38:49.065163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:38:49.066375 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5f:58c9', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe63:95d2'] 
May 14 03:38:49.066510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:38:49.066572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:38:49.066775 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:49.194892 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 03:38:49.196394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.522s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:49.198348 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:38:49.199538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.477s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:49.200399 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:38:49.200399 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:38:49.200399 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:49.204289 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:38:49.204419 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Claim successful on node np0000000741
May 14 03:38:49.280373 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Deleted allocations for instance 646c78c0-bf19-4d90-80ed-e79836dc0ecf
May 14 03:38:49.340355 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:49.593825 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:49.594043 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:49.863345 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55a9905e-8c6d-49eb-86bf-9747e82603b9 req-f3d6fc4f-f771-47a8-9611-a7a648f4a7d8 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-deleted-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:49.863345 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-55a9905e-8c6d-49eb-86bf-9747e82603b9 req-f3d6fc4f-f771-47a8-9611-a7a648f4a7d8 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Neutron deleted interface 1b3244b2-8c49-400e-a1bf-35efd21b792a; detaching it from the instance and deleting it from the info cache
May 14 03:38:49.863345 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55a9905e-8c6d-49eb-86bf-9747e82603b9 req-f3d6fc4f-f771-47a8-9611-a7a648f4a7d8 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:50.100853 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:50.104429 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:50.104706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.105426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.105623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.106089 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:50.107125 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:50.107410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:50.107657 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.107970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.108189 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.110082 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:50.110346 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state active and task_state deleting.
May 14 03:38:50.110895 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:50.111407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.111656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.111922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.112185 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:50.112396 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received unexpected event network-vif-plugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with vm_state active and task_state deleting.
May 14 03:38:50.112596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:50.112856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.113079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.113303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.113828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:50.113955 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:50.114059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:50.114165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Acquiring lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.114279 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.114366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.114462 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] No waiting events found dispatching network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:50.114588 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af3fea00-016b-4e9f-be07-041ad805ac54 req-0a552330-526f-40ae-9dbb-395338d37a51 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Received event network-vif-unplugged-1b3244b2-8c49-400e-a1bf-35efd21b792a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:38:50.164832 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Starting finish_revert_migration {{(pid=97948) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 14 03:38:50.180176 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start _get_guest_xml network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '571defbc-9543-4887-939b-0ad9b4067a4f', 'attached_at': '2026-05-14T03:38:49.000000', 'detached_at': '', 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'serial': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7'}, 'boot_index': None, 'attachment_id': '85cf411f-513c-4502-81b5-3ad976f55e9a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:50.182235 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:50.183547 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1378982848', uuid='571defbc-9543-4887-939b-0ad9b4067a4f'), owner=OwnerMeta(userid='51351b66a80d4223ab08bdc7a8aa2e57', username='tempest-ServerActionsTestOtherB-1843754337-project-member', projectid='97e6a6a9723c40a3bab2a058ab67df9f', projectname='tempest-ServerActionsTestOtherB-1843754337'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729930.18323) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:50.184768 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:50.185076 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:50.185917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:50.186126 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:50.186971 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:50.187234 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:50.187352 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:50.187436 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:50.187544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:50.187625 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:50.187748 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:50.187876 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:50.187967 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:50.188088 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:50.188184 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:50.188290 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:50.188414 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:50.289691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bc00b19f-5e08-481a-8f14-f58049252169 tempest-ServerStableDeviceRescueTest-1584222625 tempest-ServerStableDeviceRescueTest-1584222625-project-member] Lock "646c78c0-bf19-4d90-80ed-e79836dc0ecf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.460s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.301226 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:50.367168 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55a9905e-8c6d-49eb-86bf-9747e82603b9 req-f3d6fc4f-f771-47a8-9611-a7a648f4a7d8 service nova] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Detach interface failed, port_id=1b3244b2-8c49-400e-a1bf-35efd21b792a, reason: Instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:38:50.586990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:50.587246 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:50.611840 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Ignoring supplied device name: /dev/vdb
May 14 03:38:50.706854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:50.797237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:50.797824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:50.798139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:50.798631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:50.799071 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:38:50.799557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:50.801265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:50.801265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:50.801265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:38:50.803412 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Took 1.60 seconds to deallocate network for instance.
May 14 03:38:50.817151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:50.817324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:50.818042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:50.818408 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:50.819189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:50.819276 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:50.830440 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:50.830440 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:50.838297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:50.838297 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:50.846223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:50.846223 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:50.846223 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:50.846223 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:50.846223 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:50.846223 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:50.846223 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:50.846508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:50.846813 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:50.847032 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:50.850148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7] added
May 14 03:38:50.850148 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:50.850148 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:50.850148 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:50.850148 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:50.850148 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:50.850148 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:50.850425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:50.850504 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:50.850740 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:51.090564 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:51.114066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:51.310823 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:51.598390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.400s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:51.599306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.288s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:51.600293 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:38:51.847455 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:51.852173 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:51.861247 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:51.861247 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:51.864408 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:51.864408 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:51.876861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:51.880962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:51.889514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:38:51.889514 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:51.889733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:38:51.889733 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:51.889796 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:38:51.889796 np0000000741 nova-compute[97948]: 
May 14 03:38:51.896423 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:38:51.896423 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:51.896666 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:38:51.896666 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:51.896831 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:38:51.896831 np0000000741 nova-compute[97948]: 
May 14 03:38:51.986659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:38:51.986955 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:38:52.108378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:38:52.108918 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:38:52.108918 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:52.109192 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:52.180797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:52.180934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:52.181118 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Attaching volume b85b1681-7b37-473e-91a4-f735d3a371ee to /dev/vdb
May 14 03:38:52.193892 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba9e32f212f04cae8a70c44b26647a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f7491c96154009b61199ad430386d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:38:52.241930 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:52.257781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:38:52.284797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:52.326193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:38:52.326961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:38:52.336317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:38:52.337942 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5f:58c9', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe63:95d2'] 
May 14 03:38:52.338085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:38:52.338248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:38:52.338555 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:52.338922 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updating existing volume attachment record: 91a1bfb7-65ac-49b3-b2c9-05e7187c442b {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:38:52.491396 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:38:52.613709 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:38:52.899006 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:38:52.899294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:38:52.899417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:52.921016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:38:52.921016 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:38:52.921016 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:52.926428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:38:52.926428 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:38:52.926428 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:52.933426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:52.938777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:52.946337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.946337 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.946337 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:52.946594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.946594 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.946594 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:52.946894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.129s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:52.947063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:52.947445 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('7', '-', '-', 0) found on session 73 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:52.947567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:52.952879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.952879 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.952879 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:52.953021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.953021 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:52.953021 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:52.953281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.134s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:52.953434 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:52.953923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] HCTL ('8', '-', '-', 0) found on session 74 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:52.954021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:52.971807 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 73 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:52.971807 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:52.987051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Searching for a device in session 74 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:52.987051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:53.006013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.407s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:53.071563 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Deleted allocations for instance 7d8e14e9-c419-444d-9a38-73b5f8f65cba
May 14 03:38:53.117971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:38:53.290557 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Successfully created port: bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:38:53.495215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:53.667093 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:53.805555 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:53.818486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:38:53.894648 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Successfully updated port: bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:38:53.960257 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-changed-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:53.960374 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Refreshing instance network info cache due to event network-changed-bd6eaf27-8ad9-4231-bbca-c7335df3a838. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:38:53.960554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] Acquiring lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:53.960938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] Acquired lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:53.960993 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Refreshing network info cache for port bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:38:54.083687 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b28ac120-215d-4ccd-a572-275bc8e79fe8 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "7d8e14e9-c419-444d-9a38-73b5f8f65cba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.806s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:54.129977 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:38:54.131040 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:38:54.131287 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Creating image(s)
May 14 03:38:54.131837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:54.132027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:54.132494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:54.133081 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:54.136880 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:54.137869 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:54.217737 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.079s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:54.222784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:54.222784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:54.222784 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:54.228682 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:38:54.229521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:54.309804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:54.310293 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:54.357750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk 1073741824" returned: 0 in 0.047s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:54.358210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:54.358513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:54.397810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:38:54.444543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:54.445855 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:38:54.445855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:54.467855 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:54.539192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:54.539948 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Cannot resize image /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:38:54.543531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:38:54.543754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Ensure instance console log exists: /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:38:54.544023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:54.544217 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:54.544334 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:54.576673 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:54.720034 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:54.845069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Found WWN 3300000003fbc00ed for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:38:54.845069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.044s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:54.845069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:54.845069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003fbc00ed', 'path': '/dev/dm-0', 'multipath_id': '3300000003fbc00ed'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:38:54.845069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.945s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:54.845392 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:38:54.861888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:54.864008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:38:54.864823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:54.865058 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:54.865794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:38:54.866142 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:54.878037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:54.878037 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:54.883179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:38:54.883179 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:54.892730 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee] added
May 14 03:38:54.892730 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:54.892730 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:54.892730 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:54.892730 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:54.892730 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:54.892730 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:54.893063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:54.893122 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:54.893516 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:54.894425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee] added
May 14 03:38:54.894425 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:38:54.894425 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:54.894425 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:54.894425 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:38:54.894425 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:38:54.894425 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:54.894723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:38:54.894851 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:38:54.895042 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:38:55.224858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3d34974-f448-41bc-a57d-786f51704de9 req-deb2191d-bd5c-4343-b7f6-0d06ef6ee702 service nova] Releasing lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:55.225680 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquired lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:38:55.225983 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:38:55.353092 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:35Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:55.353535 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:55.354463 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:55.356514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <uuid>571defbc-9543-4887-939b-0ad9b4067a4f</uuid>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <name>instance-00000016</name>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherB-server-1378982848</nova:name>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:50</nova:creationTime>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:user uuid="51351b66a80d4223ab08bdc7a8aa2e57">tempest-ServerActionsTestOtherB-1843754337-project-member</nova:user>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:project uuid="97e6a6a9723c40a3bab2a058ab67df9f">tempest-ServerActionsTestOtherB-1843754337</nova:project>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         <nova:port uuid="30fbba53-5fb6-4c07-8fc5-9744ea6b8967">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="serial">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="uuid">571defbc-9543-4887-939b-0ad9b4067a4f</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/disk.config"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <alias name="ua-e2431725-eb78-4c32-9d4e-a2f5b07187c7"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <serial>e2431725-eb78-4c32-9d4e-a2f5b07187c7</serial>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:fd:f9:20"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <target dev="tap30fbba53-5f"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f/console.log" append="off"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:55.356514 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Preparing to wait for external event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:35Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:55.359033 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:55.359355 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:55.359663 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:55.360180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.360494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:55.360811 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:55.361679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.361850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6735a810-25f4-516a-9033-1e52f702279c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:55.363844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.364445 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:55.364973 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.367246 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.367402 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fbba53-5f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:55.367701 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30fbba53-5f, col_values=(('qos', UUID('2392bd42-8c40-49c4-8f65-d6f8c82a1f00')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:55.367852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30fbba53-5f, col_values=(('external_ids', {'iface-id': '30fbba53-5fb6-4c07-8fc5-9744ea6b8967', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:f9:20', 'vm-uuid': '571defbc-9543-4887-939b-0ad9b4067a4f'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:55.370204 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:55.374923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.375984 np0000000741 nova-compute[97948]: INFO os_vif [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:38:55.538236 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004551069998797175 future=<Future at 0x79d0b81a2600 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:55.538335 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:55.538446 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.135482870000033 future=<Future at 0x79d0b0742c00 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:55.538527 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.1353913319999265 future=<Future at 0x79d0b0742c00 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:55.538902 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778729920.537678, 571defbc-9543-4887-939b-0ad9b4067a4f => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:55.539043 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Stopped (Lifecycle Event)
May 14 03:38:55.812503 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:38:55.884862 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.894746 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:38:55.895522 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:38:55.916208 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:55.919128 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:55.919128 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:38:55.927003 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:38:55.927003 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:55.938033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:55.947724 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:55.958728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.958728 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.958728 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:55.958728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.958728 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.958728 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:55.968080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.968080 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.968080 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:55.968249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.968249 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:55.968249 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:56.001141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.50.100,3260]
May 14 03:38:56.001141 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.50.100,3260] successful.
May 14 03:38:56.001141 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:56.017958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:56.023010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:56.029832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.40.100,3260]
May 14 03:38:56.029832 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.40.100,3260] successful.
May 14 03:38:56.029832 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:56.041851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.041851 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.041851 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.041851 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.041851 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:56.043077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.043077 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.043077 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.043077 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.043077 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:56.043808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:56.044333 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:56.045612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:56.045612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] HCTL ('9', '-', '-', 0) found on session 75 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:56.045888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:56.047184 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:38:56.069904 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 75 and hctl ['9', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:56.074206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.074206 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.074206 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.074206 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.074206 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:38:56.075686 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:56.075686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:38:56.076889 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] HCTL ('10', '-', '-', 0) found on session 76 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:38:56.077187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:38:56.096662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 76 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:56.096662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:56.103573 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:56.201384 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02c7c5fd-accf-4b30-846b-fee4229ffd1c req-303cfca7-0a96-4554-8f6f-b180fa4cf20b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:56.201736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02c7c5fd-accf-4b30-846b-fee4229ffd1c req-303cfca7-0a96-4554-8f6f-b180fa4cf20b service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:56.201950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02c7c5fd-accf-4b30-846b-fee4229ffd1c req-303cfca7-0a96-4554-8f6f-b180fa4cf20b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:56.202121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02c7c5fd-accf-4b30-846b-fee4229ffd1c req-303cfca7-0a96-4554-8f6f-b180fa4cf20b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:56.202310 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02c7c5fd-accf-4b30-846b-fee4229ffd1c req-303cfca7-0a96-4554-8f6f-b180fa4cf20b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Processing event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:38:56.335123 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:56.337511 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:56.346199 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:56.369632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:56.444666 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updating instance_info_cache with network_info: [{"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:38:56.946892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Releasing lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:38:56.947170 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance network_info: |[{"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:38:56.949954 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Start _get_guest_xml network_info=[{"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:38:56.952740 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:38:56.954520 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-639199850', uuid='8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9'), owner=OwnerMeta(userid='ba9e32f212f04cae8a70c44b26647a59', username='tempest-AttachVolumeNegativeTest-1381632340-project-member', projectid='61f7491c96154009b61199ad430386d3', projectname='tempest-AttachVolumeNegativeTest-1381632340'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729936.9539104) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:38:56.955872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:38:56.956996 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:38:56.958242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:38:56.958242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:38:56.959407 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:38:56.959821 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:38:56.960204 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:38:56.960423 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:38:56.960548 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:38:56.961180 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:38:56.961180 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:38:56.961180 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:38:56.961312 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:38:56.961490 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:38:56.962034 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:38:56.962034 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:38:56.969217 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729936.9688258, 571defbc-9543-4887-939b-0ad9b4067a4f => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:56.969339 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Started (Lifecycle Event)
May 14 03:38:56.973150 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:38:56.983127 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance running successfully.
May 14 03:38:56.983905 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] finish_revert_migration finished successfully. {{(pid=97948) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 14 03:38:56.993615 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-639199850',display_name='tempest-AttachVolumeNegativeTest-server-639199850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-639199850',id=28,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGizj4EwMTGZVY+qCm2Zq6iSfwfbSFiQBvyXcmzcLI8UQvSfsbOt95/+ox8EP09kM8PrbCFCJvctxmmr/hN1pTdAItwyGhdxOghGBbcVOVszVFr5vLVbsFnzqWCDZw/ZpA==',key_name='tempest-keypair-484503271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-2p2uy7bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:38:56.994435 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:56.995215 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:56.995775 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'pci_devices' on Instance uuid 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:57.070201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Searching for a device in session 75 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:38:57.070516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:38:57.481181 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:57.485100 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:57.501994 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] End _get_guest_xml xml=<domain type="qemu">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <uuid>8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9</uuid>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <name>instance-0000001c</name>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeNegativeTest-server-639199850</nova:name>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:38:56</nova:creationTime>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:user uuid="ba9e32f212f04cae8a70c44b26647a59">tempest-AttachVolumeNegativeTest-1381632340-project-member</nova:user>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:project uuid="61f7491c96154009b61199ad430386d3">tempest-AttachVolumeNegativeTest-1381632340</nova:project>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         <nova:port uuid="bd6eaf27-8ad9-4231-bbca-c7335df3a838">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <system>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="serial">8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="uuid">8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </system>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <os>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </os>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <features>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </features>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   <devices>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.config"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </disk>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5b:c8:ff"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <target dev="tapbd6eaf27-8a"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </interface>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/console.log" append="off"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </serial>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <video>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </video>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </rng>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:   </devices>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]: </domain>
May 14 03:38:57.501994 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Preparing to wait for external event network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-639199850',display_name='tempest-AttachVolumeNegativeTest-server-639199850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-639199850',id=28,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGizj4EwMTGZVY+qCm2Zq6iSfwfbSFiQBvyXcmzcLI8UQvSfsbOt95/+ox8EP09kM8PrbCFCJvctxmmr/hN1pTdAItwyGhdxOghGBbcVOVszVFr5vLVbsFnzqWCDZw/ZpA==',key_name='tempest-keypair-484503271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-2p2uy7bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:38:57.506363 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:38:57.508075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.508075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:57.508075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:38:57.508075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.508075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4c8b985-c3ff-5d6c-a698-de3895c09dc4', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:57.510498 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.510498 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:57.510498 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.515369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.515512 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd6eaf27-8a, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:57.515838 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd6eaf27-8a, col_values=(('qos', UUID('c3eb8ee3-151d-4a94-bcaa-a957c8996a0c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:57.515982 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd6eaf27-8a, col_values=(('external_ids', {'iface-id': 'bd6eaf27-8ad9-4231-bbca-c7335df3a838', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:c8:ff', 'vm-uuid': '8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:38:57.517784 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.518570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:38:57.525570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:57.526279 np0000000741 nova-compute[97948]: INFO os_vif [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a')
May 14 03:38:57.619452 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:57.619776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:57.885766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found WWN 330000000f1b8c649 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:38:57.886076 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:38:57.886266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== connect_volume: return (4986ms) {'type': 'block', 'scsi_wwn': '330000000f1b8c649', 'path': '/dev/dm-1', 'multipath_id': '330000000f1b8c649'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:38:57.886417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f1b8c649', 'path': '/dev/dm-1', 'multipath_id': '330000000f1b8c649'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:38:57.888597 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:38:57.990705 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 14 03:38:57.991037 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729937.9907854, 571defbc-9543-4887-939b-0ad9b4067a4f => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:57.991229 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Paused (Lifecycle Event)
May 14 03:38:58.043449 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-07b06297-e418-4504-916e-bff2cdcedcb2 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance to original state: 'active'
May 14 03:38:58.122069 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:38:58.169057 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:58.297674 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:38:58.298454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:58.300710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:58.300710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:58.300710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:38:58.300710 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3b3183bb-fe01-4cfb-8f66-7c4b30698070 req-fa491838-fe7c-4c1b-9ac2-c778c15c89f5 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received unexpected event network-vif-plugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with vm_state active and task_state None.
May 14 03:38:58.391648 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Attempting to attach volume b85b1681-7b37-473e-91a4-f735d3a371ee with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:38:58.393806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:   <alias name="ua-b85b1681-7b37-473e-91a4-f735d3a371ee"/>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:   <serial>b85b1681-7b37-473e-91a4-f735d3a371ee</serial>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]: </disk>
May 14 03:38:58.393806 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:38:58.494054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:58.497967 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729938.497681, 571defbc-9543-4887-939b-0ad9b4067a4f => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:58.498133 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Resumed (Lifecycle Event)
May 14 03:38:58.503776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:38:58.678913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:58.679140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:58.682807 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:38:58.683118 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Claim successful on node np0000000741
May 14 03:38:59.002066 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:38:59.003354 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:38:59.049531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:59.049531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:38:59.049531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:5b:c8:ff, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:38:59.049531 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Using config drive
May 14 03:38:59.557818 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:38:59.674297 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00033371900008205557 future=<Future at 0x79d0b0742c00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:59.676052 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Emitting event <LifecycleEvent: 1778729924.6738667, 646c78c0-bf19-4d90-80ed-e79836dc0ecf => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:38:59.676266 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:59.676593 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] VM Stopped (Lifecycle Event)
May 14 03:38:59.678020 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.4709593850000147 future=<Future at 0x79d0b0759370 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:59.678204 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.47078634699983 future=<Future at 0x79d0b0759370 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:38:59.736217 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Creating config drive at /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.config
May 14 03:38:59.743739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmtjbi1ld {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:38:59.796444 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmtjbi1ld" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:38:59.958080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:59.959063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:59.959063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:38:59.959063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:38:59.959253 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:38:59.963850 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Terminating instance
May 14 03:38:59.986927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.081421 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:00.081816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:00.081816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:00.081816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] No VIF found with MAC fa:16:3e:5a:c5:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:00.147556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:00.147802 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:00.179631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 646c78c0-bf19-4d90-80ed-e79836dc0ecf] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:00.261398 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.290791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.385015 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.467976 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:39:00.494128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.495684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.521342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.601061 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.607671 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.611505 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.636148 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.643195 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.650584 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:00.679781 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:00.680956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:00.681141 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:00.681358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:00.681586 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:00.681669 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7353955-2bc1-4e4d-8f79-786836bf05e1 req-30b8db36-4fac-48d1-a2f9-2434dfb3313b service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:00.760418 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.795548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:00.873824 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99962496000012 future=<Future at 0x79d0b01e2b10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:00.876203 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Instance destroyed successfully.
May 14 03:39:00.876747 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lazy-loading 'resources' on Instance uuid 571defbc-9543-4887-939b-0ad9b4067a4f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:01.159473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.480s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:01.160039 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:39:01.228712 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729941.2283194, 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:01.229225 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] VM Started (Lifecycle Event)
May 14 03:39:01.380874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1378982848',display_name='tempest-ServerActionsTestOtherB-server-1378982848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestotherb-server-1378982848',id=22,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDzaocoXjqPO5FFFzctZuNhLuRDr7PGfH1bdbp+E55kGDjcht4g7hc9wdQs0EQg7zrb/KntiAuSL7kTKdHhCrCMkTbGmAbqUTQ5DGtzEZmJRjXmLTF/ejASEEBl/W3Odw==',key_name='tempest-keypair-1569636032',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:57Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97e6a6a9723c40a3bab2a058ab67df9f',ramdisk_id='',reservation_id='r-60sia86k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1843754337',owner_user_name='tempest-ServerActionsTestOtherB-1843754337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51351b66a80d4223ab08bdc7a8aa2e57',uuid=571defbc-9543-4887-939b-0ad9b4067a4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:39:01.381124 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converting VIF {"id": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "address": "fa:16:3e:fd:f9:20", "network": {"id": "6c6073ae-09f7-4f6f-8b9f-56129409f42f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1891144663-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97e6a6a9723c40a3bab2a058ab67df9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fbba53-5f", "ovs_interfaceid": "30fbba53-5fb6-4c07-8fc5-9744ea6b8967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:01.381940 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:01.382671 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:39:01.385372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.385656 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fbba53-5f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:01.386632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.387328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:01.387660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.388593 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.388752 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2392bd42-8c40-49c4-8f65-d6f8c82a1f00) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:01.389160 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.389746 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:01.390174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:01.392767 np0000000741 nova-compute[97948]: INFO os_vif [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:f9:20,bridge_name='br-int',has_traffic_filtering=True,id=30fbba53-5fb6-4c07-8fc5-9744ea6b8967,network=Network(6c6073ae-09f7-4f6f-8b9f-56129409f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fbba53-5f')
May 14 03:39:01.394190 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:01.394739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:01.394898 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:01.395428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:01.395870 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2431725-eb78-4c32-9d4e-a2f5b07187c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:01.396052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:01.419943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:39:01.419943 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:39:01.419943 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:01.419943 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:01.419943 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:01.420193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsi session list stdout=tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:39:01.420193 np0000000741 nova-compute[97948]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7 (non-flash)
May 14 03:39:01.420193 np0000000741 nova-compute[97948]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:01.420193 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:01.420193 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:01.420193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:01.420395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '73')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:01.421083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7', '74')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:01.421727 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81479c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:01.421909 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:39:01.422116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Flush multipath device 3300000003fbc00ed {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:39:01.454833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:01.501192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:01.557328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:39:01.557556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:39:01.558631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:39:01.577952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:39:01.578227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:01.596312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.630426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260]
May 14 03:39:01.630426 np0000000741 nova-compute[97948]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.40.100,3260] successful.
May 14 03:39:01.630426 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.631395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f540ccdc-10e9-4787-9067-35d6cb9559a4 tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.450s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:01.645725 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.661667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.666128 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:39:01.666424 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:39:01.666805 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:01.669232 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:01.700943 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260]
May 14 03:39:01.700943 np0000000741 nova-compute[97948]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-e2431725-eb78-4c32-9d4e-a2f5b07187c7, portal: 192.168.50.100,3260] successful.
May 14 03:39:01.700943 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.718353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:01.718654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:01.718820 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] <== disconnect_volume: return (324ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:01.718963 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:01.719269 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Deleting instance files /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_del
May 14 03:39:01.726107 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Deletion of /opt/stack/data/nova/instances/571defbc-9543-4887-939b-0ad9b4067a4f_del complete
May 14 03:39:01.734383 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:01.736062 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729941.7357967, 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:01.736130 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] VM Paused (Lifecycle Event)
May 14 03:39:01.761821 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03f07c927d2143d2961164592bd62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3492928cd5f64475bf5572822120dbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:39:02.169172 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:39:02.232109 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Took 1.76 seconds to destroy the instance on the hypervisor.
May 14 03:39:02.232678 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:39:02.234555 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:39:02.235157 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Successfully created port: dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:39:02.236504 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:39:02.236738 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:02.238475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:02.240072 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:02.312764 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:02.674765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:39:02.742271 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:02.769189 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:02.769715 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] Acquiring lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:02.769962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:02.770095 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] Lock "571defbc-9543-4887-939b-0ad9b4067a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:02.770263 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] No waiting events found dispatching network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:02.770438 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c96052c-1ba4-486c-aa30-cbeec24c7ffc req-ba503233-c5a9-4fff-883f-f3b6e2b4a494 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-unplugged-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:02.840496 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Successfully updated port: dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:39:02.891450 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-changed-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:02.891664 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Refreshing instance network info cache due to event network-changed-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:02.891841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] Acquiring lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:02.891961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] Acquired lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:02.892062 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Refreshing network info cache for port dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:03.090107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:03.090279 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:03.149659 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00044311100009508664 future=<Future at 0x79d0b0759370 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:03.150378 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Emitting event <LifecycleEvent: 1778729928.1489046, 7d8e14e9-c419-444d-9a38-73b5f8f65cba => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:03.150520 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:03.150734 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] VM Stopped (Lifecycle Event)
May 14 03:39:03.151715 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.721748781000088 future=<Future at 0x79d0b01e2b10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:03.151953 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.721533996000062 future=<Future at 0x79d0b01e2b10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:03.298488 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:03.342619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:03.394196 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:03.464781 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:03.506669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:03.592405 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:39:03.608665 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:03.653367 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 7d8e14e9-c419-444d-9a38-73b5f8f65cba] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:03.683341 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:39:03.684535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:39:03.684821 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Creating image(s)
May 14 03:39:03.685512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:03.685724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:03.686584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:03.687320 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:03.691701 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:03.693111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:03.794993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:03.795448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:03.796061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:03.797842 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:03.800732 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:03.801904 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Took 1.57 seconds to deallocate network for instance.
May 14 03:39:03.802490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:03.893566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:03.894096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:03.949046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk 1073741824" returned: 0 in 0.055s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:03.951337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:03.951912 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:04.055977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:04.057653 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:39:04.057653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:04.111031 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-659cf387-4f0a-4408-b5d9-38002c144f27 req-cc584eef-93bb-4177-aefb-3470a1958593 service nova] Releasing lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:04.114059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquired lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:04.114319 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:04.162585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:04.162927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:04.163278 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:04.163478 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Cannot resize image /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:39:04.163812 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:04.164804 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Ensure instance console log exists: /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:39:04.164804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:04.164804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:04.164804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:04.168991 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:39:04.168991 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Claim successful on node np0000000741
May 14 03:39:04.365865 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:39:04.684867 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:04.844301 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08322f44-2b16-4332-b916-3ddc0a38285a req-4f192622-4903-4ef4-9d3d-d340c4032839 service nova] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Received event network-vif-deleted-30fbba53-5fb6-4c07-8fc5-9744ea6b8967 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:04.860607 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:04.871919 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:04.957490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da96bdb-7f5b-4666-8a9e-4dc770838698 req-f703e42a-87ba-488c-975e-51be029ad6c9 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:04.961506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da96bdb-7f5b-4666-8a9e-4dc770838698 req-f703e42a-87ba-488c-975e-51be029ad6c9 service nova] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:04.961628 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da96bdb-7f5b-4666-8a9e-4dc770838698 req-f703e42a-87ba-488c-975e-51be029ad6c9 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:04.961828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da96bdb-7f5b-4666-8a9e-4dc770838698 req-f703e42a-87ba-488c-975e-51be029ad6c9 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:04.961960 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da96bdb-7f5b-4666-8a9e-4dc770838698 req-f703e42a-87ba-488c-975e-51be029ad6c9 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Processing event network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:39:04.962964 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:04.969266 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:04.971452 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729944.970993, 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:04.971621 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] VM Resumed (Lifecycle Event)
May 14 03:39:04.971926 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance spawned successfully.
May 14 03:39:04.972885 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:05.006109 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating instance_info_cache with network_info: [{"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:05.480158 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:05.485156 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:05.487949 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.488262 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.489414 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.489414 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.490374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.490374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:05.508036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Releasing lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:05.508273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance network_info: |[{"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:39:05.510387 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Start _get_guest_xml network_info=[{"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:05.520422 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:05.522432 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1395909558', uuid='430aef38-650f-4a88-a6c3-4f7ec9a5c6d1'), owner=OwnerMeta(userid='03f07c927d2143d2961164592bd62449', username='tempest-AttachVolumeTestJSON-1091031368-project-member', projectid='3492928cd5f64475bf5572822120dbbc', projectname='tempest-AttachVolumeTestJSON-1091031368'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729945.521784) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:05.524060 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:05.524564 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:05.525539 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:05.525788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:05.526779 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:05.527086 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:05.527201 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:05.527347 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:05.527425 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:05.527515 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:05.527603 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:05.527849 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:05.527984 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:05.528069 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:05.528242 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:05.528526 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:05.541864 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1395909558',display_name='tempest-AttachVolumeTestJSON-server-1395909558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1395909558',id=29,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2r8+TDLSzJhL/Oc1Ot8OmBDPOm3JCTgpTGlMa91L+BsuDL7N3EupTkeZJ//bukdpZjAQXo3DJhIx8061Se3TQNTSlcp6yPDsnNneJtNr6vvBP5HoRkZIbyxHePKIRcJg==',key_name='tempest-keypair-229393330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-4ci61rp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=430aef38-650f-4a88-a6c3-4f7ec9a5c6d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:05.541864 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:05.544659 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:05.544659 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'pci_devices' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:05.682387 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:05.682965 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:05.987620 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:05.997221 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Took 11.87 seconds to spawn the instance on the hypervisor.
May 14 03:39:05.997563 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:06.050327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <uuid>430aef38-650f-4a88-a6c3-4f7ec9a5c6d1</uuid>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <name>instance-0000001d</name>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeTestJSON-server-1395909558</nova:name>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:05</nova:creationTime>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:user uuid="03f07c927d2143d2961164592bd62449">tempest-AttachVolumeTestJSON-1091031368-project-member</nova:user>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:project uuid="3492928cd5f64475bf5572822120dbbc">tempest-AttachVolumeTestJSON-1091031368</nova:project>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         <nova:port uuid="dd99c42b-1c62-46bb-b5e0-ff23fd0953e7">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="serial">430aef38-650f-4a88-a6c3-4f7ec9a5c6d1</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="uuid">430aef38-650f-4a88-a6c3-4f7ec9a5c6d1</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.config"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:54:94:99"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <target dev="tapdd99c42b-1c"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/console.log" append="off"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:06.050327 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Preparing to wait for external event network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1395909558',display_name='tempest-AttachVolumeTestJSON-server-1395909558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1395909558',id=29,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2r8+TDLSzJhL/Oc1Ot8OmBDPOm3JCTgpTGlMa91L+BsuDL7N3EupTkeZJ//bukdpZjAQXo3DJhIx8061Se3TQNTSlcp6yPDsnNneJtNr6vvBP5HoRkZIbyxHePKIRcJg==',key_name='tempest-keypair-229393330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-4ci61rp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=430aef38-650f-4a88-a6c3-4f7ec9a5c6d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:06.052928 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:06.053367 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:39:06.053367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.053711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:06.053985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:39:06.054766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.054913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22b49bfa-1e98-55d3-9653-5d97fa0fcfd0', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:06.064573 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.065054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:06.065222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.067468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.067654 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd99c42b-1c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:06.068003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd99c42b-1c, col_values=(('qos', UUID('451be9c0-fa10-45df-aeb4-b60793e17aa4')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:06.068196 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd99c42b-1c, col_values=(('external_ids', {'iface-id': 'dd99c42b-1c62-46bb-b5e0-ff23fd0953e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:94:99', 'vm-uuid': '430aef38-650f-4a88-a6c3-4f7ec9a5c6d1'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:06.068951 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.070229 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:06.074567 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:06.075126 np0000000741 nova-compute[97948]: INFO os_vif [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c')
May 14 03:39:06.186299 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:06.508814 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Took 18.85 seconds to build instance.
May 14 03:39:06.694886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.532s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:06.695593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.823s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:06.695859 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:39:06.701056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.006s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:06.768916 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Deleted allocations for instance 571defbc-9543-4887-939b-0ad9b4067a4f
May 14 03:39:07.011817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3d086f8c-3d20-448d-9104-6e68b9075f3c tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.364s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:07.030805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:07.032037 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:07.032276 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:07.033245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:07.033755 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] No waiting events found dispatching network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:07.033888 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-49ece3fd-0996-41f6-9648-772c9330738c req-a92ce240-de6d-4d89-a140-949d8a28d74e service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received unexpected event network-vif-plugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 for instance with vm_state active and task_state None.
May 14 03:39:07.204384 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:39:07.204537 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:39:07.204808 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:07.205031 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:07.315663 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755776b8b15e43bbac70f82cfea689e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce458cafea74d40af089b430f6b92ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:39:07.530828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-changed-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:07.530828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Refreshing instance network info cache due to event network-changed-bd6eaf27-8ad9-4231-bbca-c7335df3a838. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:07.531861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] Acquiring lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:07.531861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] Acquired lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:07.531861 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Refreshing network info cache for port bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:07.602856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:07.603069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:07.603851 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:54:94:99, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:07.604008 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Using config drive
May 14 03:39:07.707377 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:39:07.781748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4083e7e7-6406-4d9b-8afc-18976d816702 tempest-ServerActionsTestOtherB-1843754337 tempest-ServerActionsTestOtherB-1843754337-project-member] Lock "571defbc-9543-4887-939b-0ad9b4067a4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.822s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:08.035318 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:08.117332 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:08.144537 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Successfully created port: 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:39:08.212060 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:39:08.309354 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Creating config drive at /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.config
May 14 03:39:08.314503 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphigb96c4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:08.378826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphigb96c4" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:08.487419 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:08.504957 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:08.666386 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updated VIF entry in instance network info cache for port bd6eaf27-8ad9-4231-bbca-c7335df3a838. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:39:08.666872 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updating instance_info_cache with network_info: [{"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:08.866426 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Successfully updated port: 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:39:08.868049 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:08.896098 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:08.900367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:09.004772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:09.142074 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bfd10efd-31bb-401f-913e-22d925e4949d req-22848401-2699-46b7-a5e1-27101e9480b1 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:09.142568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bfd10efd-31bb-401f-913e-22d925e4949d req-22848401-2699-46b7-a5e1-27101e9480b1 service nova] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:09.142568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bfd10efd-31bb-401f-913e-22d925e4949d req-22848401-2699-46b7-a5e1-27101e9480b1 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:09.144578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bfd10efd-31bb-401f-913e-22d925e4949d req-22848401-2699-46b7-a5e1-27101e9480b1 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:09.144994 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bfd10efd-31bb-401f-913e-22d925e4949d req-22848401-2699-46b7-a5e1-27101e9480b1 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Processing event network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:39:09.173431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc5efac2-43a2-4e85-8bd1-b84fb2502dd3 req-aa4c96aa-0034-4e3c-a3ac-a11b713be53c service nova] Releasing lock "refresh_cache-8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:09.227695 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:39:09.228709 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:39:09.228960 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating image(s)
May 14 03:39:09.229479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:09.229629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:09.230724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:09.231336 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:09.234542 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:09.235848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:09.259854 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:09.285978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:09.344326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:09.345088 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:09.346068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:09.346574 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:09.353012 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:09.354485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:09.386850 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:09.386850 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:09.386850 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:09.461844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:09.462233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:09.516528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk 1073741824" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:09.517782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:09.518138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:09.607920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:09.608612 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:39:09.608976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:09.629842 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:09.630029 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing instance network info cache due to event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:09.630365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:09.708632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:09.708989 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Cannot resize image /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:39:09.709356 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:09.709502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Ensure instance console log exists: /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:39:09.709862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:09.709922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:09.710072 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:09.823595 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:09.825353 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729949.8243537, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:09.825353 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] VM Started (Lifecycle Event)
May 14 03:39:09.827306 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:09.831911 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance spawned successfully.
May 14 03:39:09.832327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:09.989339 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:10.212914 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:10.327920 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:10.331231 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.343705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:10.403158 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:10.833658 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:10.833967 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729950.8337526, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:10.834124 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] VM Paused (Lifecycle Event)
May 14 03:39:10.848471 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Took 7.16 seconds to spawn the instance on the hypervisor.
May 14 03:39:10.849182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:10.905775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:10.906058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance network_info: |[{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:39:10.906354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:10.906511 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:10.909126 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start _get_guest_xml network_info=[{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:10.913411 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:10.914047 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1674772814', uuid='a7a81f92-a39b-4a10-9868-39e256c3bc33'), owner=OwnerMeta(userid='755776b8b15e43bbac70f82cfea689e2', username='tempest-AttachVolumeShelveTestJSON-1886486107-project-member', projectid='bce458cafea74d40af089b430f6b92ce', projectname='tempest-AttachVolumeShelveTestJSON-1886486107'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729950.913706) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:10.914971 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:10.915571 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:10.917327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:10.917709 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:10.918608 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:10.918918 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:10.919834 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:10.920037 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:10.920037 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:10.933374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzAVkeN8U7bIwitu7X+vC8w6QVojMw7Hmjcxq0rXUC5esnPDvt1R9j1YT6MZzhOjqqK8fZ8utHrFjDuzFxepKMS4Kjts4MxrrWr/TtvDtPavQDqzqyqyE2Mi+uBEsy1oA==',key_name='tempest-keypair-1288155932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:10.933683 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:10.934440 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:10.935391 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_devices' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:11.070514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.093808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:11.094007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:11.219064 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:11.219688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:11.219688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:11.219888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:11.219988 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] No waiting events found dispatching network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:11.220144 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b276723c-2d32-4c54-90e3-5e4e17a54420 req-a7f08e50-659b-4bde-acba-8b3aca374140 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received unexpected event network-vif-plugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 for instance with vm_state active and task_state None.
May 14 03:39:11.336511 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:11.338032 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729951.3378298, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:11.338137 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] VM Resumed (Lifecycle Event)
May 14 03:39:11.360651 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Took 12.73 seconds to build instance.
May 14 03:39:11.412280 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:11.418535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.438260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <uuid>a7a81f92-a39b-4a10-9868-39e256c3bc33</uuid>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <name>instance-0000001e</name>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1674772814</nova:name>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:10</nova:creationTime>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:user uuid="755776b8b15e43bbac70f82cfea689e2">tempest-AttachVolumeShelveTestJSON-1886486107-project-member</nova:user>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:project uuid="bce458cafea74d40af089b430f6b92ce">tempest-AttachVolumeShelveTestJSON-1886486107</nova:project>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         <nova:port uuid="25254b82-6c2d-4326-b9f8-543a5c64160d">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="serial">a7a81f92-a39b-4a10-9868-39e256c3bc33</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="uuid">a7a81f92-a39b-4a10-9868-39e256c3bc33</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:dd:c5:54"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <target dev="tap25254b82-6c"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/console.log" append="off"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:11.438260 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Preparing to wait for external event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzAVkeN8U7bIwitu7X+vC8w6QVojMw7Hmjcxq0rXUC5esnPDvt1R9j1YT6MZzhOjqqK8fZ8utHrFjDuzFxepKMS4Kjts4MxrrWr/TtvDtPavQDqzqyqyE2Mi+uBEsy1oA==',key_name='tempest-keypair-1288155932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:39:11.440302 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:11.440947 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:11.441989 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:39:11.443428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.443699 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:11.443933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:39:11.445167 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.445378 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e62ebe-307d-544b-a6c6-a3a19343a256', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:11.448195 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:11.451784 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.451972 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25254b82-6c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:11.452314 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25254b82-6c, col_values=(('qos', UUID('8e15ba9f-afd9-4a01-82ad-9cbe382b6f9c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:11.452462 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25254b82-6c, col_values=(('external_ids', {'iface-id': '25254b82-6c2d-4326-b9f8-543a5c64160d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c5:54', 'vm-uuid': 'a7a81f92-a39b-4a10-9868-39e256c3bc33'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:11.454072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.455411 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:11.461300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:11.462605 np0000000741 nova-compute[97948]: INFO os_vif [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c')
May 14 03:39:11.597530 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:11.753858 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:11.840827 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:11.846367 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:11.867668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2ca56465-9911-484f-a7b4-e19e9a9b4f52 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.246s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:11.938266 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updated VIF entry in instance network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:39:11.938526 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:12.101141 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Ignoring supplied device name: /dev/vdb
May 14 03:39:12.445266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-45e1bd64-6cc0-49e1-a396-c3973aba0e96 req-3d11fe64-3da9-4c6b-bd22-4ed01950cf5c service nova] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:12.602508 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:12.984853 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:12.985006 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:12.985263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No VIF found with MAC fa:16:3e:dd:c5:54, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:12.985629 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Using config drive
May 14 03:39:13.293882 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-changed-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:13.297900 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Refreshing instance network info cache due to event network-changed-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:13.298069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] Acquiring lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:13.298184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] Acquired lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:13.298307 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Refreshing network info cache for port dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:13.495850 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:13.510173 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:13.689681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:13.689834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:13.690026 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Attaching volume 6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 to /dev/vdb
May 14 03:39:13.740389 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:13.753124 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating config drive at /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config
May 14 03:39:13.757622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp86beo2x9 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:13.770741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:39:13.794984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:13.810992 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:13.818407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp86beo2x9" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:13.837078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:39:13.837345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:39:13.845444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:39:13.846768 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5f:58c9', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe63:95d2', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e'] 
May 14 03:39:13.852304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:39:13.852304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:39:13.852663 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:13.853230 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating existing volume attachment record: 45a59670-5e33-4003-8be5-ce9bef418ef3 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:39:14.167530 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:14.348335 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updated VIF entry in instance network info cache for port dd99c42b-1c62-46bb-b5e0-ff23fd0953e7. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:39:14.348490 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating instance_info_cache with network_info: [{"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:14.359709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.395561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.428929 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:39:14.429454 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:14.429737 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:14.430273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:14.430551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:39:14.446391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:14.446819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:14.446997 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:14.451235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:14.451659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:14.451860 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:14.459588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:14.459588 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:14.479764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2] added
May 14 03:39:14.479764 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:14.479764 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:14.479764 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:14.479764 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:14.479764 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:14.479764 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:14.480141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:14.480734 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:14.480935 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:14.481346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:14.481346 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:14.500754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2] added
May 14 03:39:14.500754 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:14.500754 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:14.500754 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:14.500754 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:14.500754 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:14.500754 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:14.501279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:14.501279 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:14.501813 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:14.503958 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.715769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.719232 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.726763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.751024 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc490251-7953-44b9-8330-90f0502a8e48 req-c526c330-8344-467c-a3ba-a44cfe7a021b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:14.751276 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc490251-7953-44b9-8330-90f0502a8e48 req-c526c330-8344-467c-a3ba-a44cfe7a021b service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:14.751658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc490251-7953-44b9-8330-90f0502a8e48 req-c526c330-8344-467c-a3ba-a44cfe7a021b service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:14.751658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc490251-7953-44b9-8330-90f0502a8e48 req-c526c330-8344-467c-a3ba-a44cfe7a021b service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:14.751780 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc490251-7953-44b9-8330-90f0502a8e48 req-c526c330-8344-467c-a3ba-a44cfe7a021b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Processing event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:39:14.752603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:14.851655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-03c4c605-6182-4b95-96c3-4e8d488cac0d req-4170d5c3-d7d3-4427-9cb5-9ab7ea32dd97 service nova] Releasing lock "refresh_cache-430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:15.308602 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729955.3081431, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:15.308789 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Started (Lifecycle Event)
May 14 03:39:15.310563 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:15.315571 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:15.317915 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance spawned successfully.
May 14 03:39:15.318576 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:15.481621 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:15.504431 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:15.506051 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:15.506051 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:15.519923 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:15.519923 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.523278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.534856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.543432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.543432 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.543432 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.543432 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:15.543841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.543841 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.543841 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.543841 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.566406 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:15.578931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.40.100,3260]
May 14 03:39:15.578931 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.40.100,3260] successful.
May 14 03:39:15.578931 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.593832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.606317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.50.100,3260]
May 14 03:39:15.606317 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.50.100,3260] successful.
May 14 03:39:15.606317 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.613386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.613386 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.613386 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.613386 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.613386 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.613386 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:15.613823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.613823 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.613823 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.613823 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.613823 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.613823 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:15.613976 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:15.614061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:15.614932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] HCTL ('8', '-', '-', 0) found on session 78 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:15.615087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:15.625437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e818d66-bdae-40f5-a27e-7a6f1d007552 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:15.648822 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:15.648822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:15.655260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] HCTL ('11', '-', '-', 0) found on session 79 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:15.655260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:15.675906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Searching for a device in session 79 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:15.675906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:15.813078 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:15.814971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:15.832908 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.833181 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.833538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.833969 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.834353 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.834983 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:15.874257 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007245599999805563 future=<Future at 0x79d0b01e2b10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:15.874461 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:15.874902 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Emitting event <LifecycleEvent: 1778729940.8733304, 571defbc-9543-4887-939b-0ad9b4067a4f => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:15.875246 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] VM Stopped (Lifecycle Event)
May 14 03:39:16.088872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:16.318194 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:16.318373 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729956.3181813, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:16.318565 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Paused (Lifecycle Event)
May 14 03:39:16.342708 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Took 7.11 seconds to spawn the instance on the hypervisor.
May 14 03:39:16.343355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:16.379040 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: 571defbc-9543-4887-939b-0ad9b4067a4f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:16.452458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:39:16.454953 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:16.824944 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:16.825617 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729956.8250995, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:16.825617 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Resumed (Lifecycle Event)
May 14 03:39:16.832739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:16.833334 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:16.833465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:16.833851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:16.833981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:16.834746 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-05ffec03-699e-4b1a-8eb5-100a03982192 req-1a261447-ae56-4422-a72b-1ee8dd5baaa8 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received unexpected event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with vm_state active and task_state None.
May 14 03:39:16.854936 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Took 12.75 seconds to build instance.
May 14 03:39:17.332653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:17.336428 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:17.359858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b227ddf8-0949-49d5-a776-87ec87de583c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.269s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:17.475946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found WWN 3300000003b8089b5 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:39:17.476973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:17.476973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000003b8089b5', 'path': '/dev/dm-0', 'multipath_id': '3300000003b8089b5'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:17.476973 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b8089b5', 'path': '/dev/dm-0', 'multipath_id': '3300000003b8089b5'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:39:17.479830 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:17.667288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:17.667288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:17.785581 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:17.787154 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:39:17.985396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Attempting to attach volume 6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:39:17.986307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:   <alias name="ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2"/>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:   <serial>6b5c3b87-b9b6-4a1c-8351-0177d44d75b2</serial>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:17.986307 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:39:18.092468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:18.174723 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'flavor' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:18.510296 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:18.900145 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:18.900534 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing instance network info cache due to event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:18.900732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:18.900826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:18.900935 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:19.180842 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:19.402731 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:19.661690 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:19.661856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:19.662001 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:19.662223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No VIF found with MAC fa:16:3e:5f:58:c9, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:19.727422 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:19.783206 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:19.783399 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:19.784045 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:39:19.904437 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updated VIF entry in instance network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:39:19.904810 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:19.915152 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:19.915403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:20.356615 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:20.357016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:20.357190 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attaching volume 93a21d9f-3ce6-4706-8db7-b662eee126ea to /dev/vdb
May 14 03:39:20.407764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c339425a-047f-4430-b0ce-b9fdfc7a7fd6 req-3d4f9a04-6f1c-43df-a8b2-2ed83cf97698 service nova] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:20.409146 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:20.422689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:39:20.429761 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:39:20.450781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:20.505880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:39:20.506330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:39:20.517512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:39:20.525501 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5f:58c9', 'fe80::f448:67ff:fe8e:dd11', 'fe80::fc16:3eff:fe63:95d2', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48'] 
May 14 03:39:20.525501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:39:20.525501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:39:20.525501 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:20.525501 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating existing volume attachment record: ce382e12-e68e-42c1-8dea-ae1dfd2f4314 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:39:20.680228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:20.680600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:20.999821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:21.000139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:21.005398 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:39:21.005603 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Claim successful on node np0000000741
May 14 03:39:21.098749 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:39:21.099235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:21.099407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:21.184486 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:39:21.239284 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-76fafce3-3950-4e35-848e-3ea66e27b882 tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.549s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:21.456998 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:21.729164 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:21.783197 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:21.783429 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:21.783607 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:21.783763 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:39:21.783921 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:22.289899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:22.505241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:22.505608 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:23.008806 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:23.160077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.060s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:23.160345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:39:23.174386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:23.175097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:23.175652 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:23.175903 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:23.176407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:23.176604 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:23.189301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:23.189301 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:23.199835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:23.199835 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea] added
May 14 03:39:23.207688 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:23.207688 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:23.207688 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:23.212597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea] added
May 14 03:39:23.212597 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:23.212597 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:23.212597 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:23.212597 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:23.212597 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:23.212597 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:23.212954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:23.212954 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:23.213117 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:23.512185 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:23.517911 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.518s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:23.518664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.789s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:23.518918 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:39:23.524146 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:39:23.524363 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Claim successful on node np0000000741
May 14 03:39:24.033065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:39:24.040842 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:39:24.040842 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:24.040842 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:24.130726 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bde0629c78549de8126765cd827cd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3eb60c511814747813d717f2e02a441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:39:24.206567 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:24.214631 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:24.227243 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:24.227243 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:24.238749 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:24.238749 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.242217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.250970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.260596 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:24.269018 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.269018 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.269018 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.269018 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.269018 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.269018 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:24.269225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.269225 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.269225 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.269225 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.269225 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.269225 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:24.301141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260]
May 14 03:39:24.301141 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260] successful.
May 14 03:39:24.301141 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.304530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260]
May 14 03:39:24.304530 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260] successful.
May 14 03:39:24.304530 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.319739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.329963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.338882 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:24.338882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:24.340562 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('12', '-', '-', 0) found on session 81 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:24.340788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:24.352581 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:24.352581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:24.353111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:24.353489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('13', '-', '-', 0) found on session 82 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:24.353632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:24.367069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 81 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:24.367069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:24.387629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 82 and hctl ['13', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:24.539628 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:39:24.737732 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Successfully created port: decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:39:25.047694 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:39:25.164035 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:25.164310 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:25.383857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 82 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:25.384128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:25.396501 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Successfully updated port: decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:39:25.446455 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-changed-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:25.446825 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Refreshing instance network info cache due to event network-changed-decbf6dd-5954-4ec6-8e05-f7397f8b9453. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:25.447117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] Acquiring lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:25.447308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] Acquired lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:25.448226 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Refreshing network info cache for port decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:25.667969 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:25.899931 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:25.950317 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:26.016120 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:26.065970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:39:26.066867 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:39:26.067135 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Creating image(s)
May 14 03:39:26.067592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:26.067768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:26.068268 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:26.068825 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:26.072417 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:26.074662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:26.180153 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.662s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:26.185891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:26.186309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.891s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:26.188123 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:39:26.192839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.006s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:26.193608 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:39:26.195824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:26.200462 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:26.202049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found WWN 3300000001d0409bf for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:39:26.206084 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:26.207390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== connect_volume: return (5106ms) {'type': 'block', 'scsi_wwn': '3300000001d0409bf', 'path': '/dev/dm-2', 'multipath_id': '3300000001d0409bf'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:26.207390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001d0409bf', 'path': '/dev/dm-2', 'multipath_id': '3300000001d0409bf'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:39:26.208750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.020s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:26.211446 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:26.227151 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:26.229259 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'flavor' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:26.233763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:26.344845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:26.347262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:26.435257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk 1073741824" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:26.439056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:26.439056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:26.459775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:26.551513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:26.552704 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:39:26.553128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:26.654523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Cannot resize image /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:26.657630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:26.700182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:39:26.700657 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:39:26.700923 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:26.701257 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:26.708706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f5d21f4-c56d-4307-9622-002bcbcb842d req-e64f5b37-a577-4c1f-9f93-ec033992d822 service nova] Releasing lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:26.708706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:26.708990 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:26.737378 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attempting to attach volume 93a21d9f-3ce6-4706-8db7-b662eee126ea with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:39:26.740356 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:   <alias name="ua-93a21d9f-3ce6-4706-8db7-b662eee126ea"/>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:   <serial>93a21d9f-3ce6-4706-8db7-b662eee126ea</serial>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:26.740356 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:39:26.800694 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bde0629c78549de8126765cd827cd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3eb60c511814747813d717f2e02a441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:39:27.206382 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:39:27.291371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:27.317708 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:27.433246 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Successfully created port: 98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:39:27.451770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:27.455558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:27.515116 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:27.515572 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:27.539623 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:27.566873 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:27.572280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:27.622688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:27.675193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:27.675830 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:27.714452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:39:27.763148 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:27.788115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:27.792221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:27.898528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:27.899342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.017441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.021676 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Detaching volume 6b5c3b87-b9b6-4a1c-8351-0177d44d75b2
May 14 03:39:28.026182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.052502 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Successfully updated port: 98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:39:28.116968 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-changed-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:28.117505 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Refreshing instance network info cache due to event network-changed-98fcba70-7fed-4df9-8c59-51793016a49f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:39:28.117859 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] Acquiring lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:28.117859 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] Acquired lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:28.117990 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Refreshing network info cache for port 98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:39:28.128396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.128934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.152646 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Attempting to driver detach volume 6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 from mountpoint /dev/vdb
May 14 03:39:28.159823 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found disk vdb by alias ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:39:28.162361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Found disk vdb by alias ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:39:28.162505 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Attempting to detach device vdb from instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:39:28.162910 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <alias name="ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2"/>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <serial>6b5c3b87-b9b6-4a1c-8351-0177d44d75b2</serial>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:28.162910 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:39:28.171168 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully detached device vdb from instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 from the persistent domain config.
May 14 03:39:28.171343 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] (1/8): Attempting to detach device vdb with device alias ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 from instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:39:28.171685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <alias name="ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2"/>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <serial>6b5c3b87-b9b6-4a1c-8351-0177d44d75b2</serial>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:28.171685 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:39:28.232728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.234103 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:39:28.238957 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.268365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:28.269151 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance network_info: |[{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:39:28.272557 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start _get_guest_xml network_info=[{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:28.279345 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:28.281652 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1705297539', uuid='1c7ec2de-3093-4b9c-9b5b-58aad8cf125c'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729968.2810657) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:28.283997 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:28.284484 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:28.285514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:28.285742 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:28.287379 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:28.287844 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:28.288148 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:28.288354 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:28.288525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:28.288675 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:28.288811 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:28.289034 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:28.289177 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:28.289326 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:28.289481 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:28.289633 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:28.308224 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1705297539',display_name='tempest-ServerRescueNegativeTestJSON-server-1705297539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1705297539',id=31,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-waw0p200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:25Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=1c7ec2de-3093-4b9c-9b5b-58aad8cf125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:28.308224 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:28.308626 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:28.310660 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:28.336050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.336706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.431044 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.431531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:39:28.435274 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.521361 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.530752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.530983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.566941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:28.604447 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:28.604614 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:28.604788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:28.605004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:63:95:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:28.621566 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:28.647192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.653003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.735940 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:39:28.740130 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:39:28.740381 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Creating image(s)
May 14 03:39:28.740941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:28.741158 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:28.742128 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:28.743854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:28.744442 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:28.748066 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:28.749800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.770101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.775141 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.811324 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729968.8088312, 0a1da0b4-8ee8-47f4-bea2-cff35980e148 => ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:39:28.811864 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 for instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:39:28.816298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <uuid>1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</uuid>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <name>instance-0000001f</name>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1705297539</nova:name>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:28</nova:creationTime>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         <nova:port uuid="decbf6dd-5954-4ec6-8e05-f7397f8b9453">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="serial">1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="uuid">1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:ec:7d:1a"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <target dev="tapdecbf6dd-59"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/console.log" append="off"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:28.816298 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Preparing to wait for external event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1705297539',display_name='tempest-ServerRescueNegativeTestJSON-server-1705297539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1705297539',id=31,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-waw0p200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:25Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=1c7ec2de-3093-4b9c-9b5b-58aad8cf125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:39:28.822335 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:28.823755 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:28.824090 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:39:28.825721 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.826176 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:28.826484 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:39:28.827872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.828659 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully detached device vdb from instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 from the live domain config.
May 14 03:39:28.828842 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '186f443e-f469-55bd-8539-f7e536a05e79', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:28.831762 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:28.831762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:28.833213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.834019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:28.834019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:28.834214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:28.834549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:28.834729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:28.838746 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.839190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdecbf6dd-59, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:28.839799 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdecbf6dd-59, col_values=(('qos', UUID('7a6764c8-84bd-4f7d-96ab-03f7697e77d7')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:28.840070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdecbf6dd-59, col_values=(('external_ids', {'iface-id': 'decbf6dd-5954-4ec6-8e05-f7397f8b9453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7d:1a', 'vm-uuid': '1c7ec2de-3093-4b9c-9b5b-58aad8cf125c'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:28.841392 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.842977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:28.847951 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:28.852036 np0000000741 nova-compute[97948]: INFO os_vif [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59')
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:28.867110 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2 (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5 (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:28.867413 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:28.867550 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e62dfb0-3f71-4531-84cf-432a25d196f5', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '82')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:28.867622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', '78')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:28.868834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', '79')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:28.877455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.877821 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:39:28.878607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.129s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.879219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:28.880126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8145bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:28.881141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Removing multipathed devices sdc, sdf {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:39:28.881661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:28.882468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Flush multipath device 3300000003b8089b5 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:39:28.883453 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:28.890695 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:28.891791 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:28.892770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.893016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:28.926148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:28.940491 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:28.941153 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12022MB free_disk=73.18046951293945GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:39:28.941452 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:28.941962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:28.971703 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:28.998290 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:29.002950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:29.003312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:29.017109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking to see if SCSI volumes sdc, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:39:29.017404 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] SCSI volumes sdc, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:39:29.021541 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Checking to see if device paths {'sdc', 'sdf'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:39:29.035622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Device paths {'sdc', 'sdf'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:39:29.035950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:29.048712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.064796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk 1073741824" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:29.065317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:29.065686 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:29.084344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.40.100,3260]
May 14 03:39:29.084344 np0000000741 nova-compute[97948]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.40.100,3260] successful.
May 14 03:39:29.084344 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.102154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.114925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.150090 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.50.100,3260]
May 14 03:39:29.150090 np0000000741 nova-compute[97948]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, portal: 192.168.50.100,3260] successful.
May 14 03:39:29.150090 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.157757 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:29.158263 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:39:29.158605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:29.175824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:29.176757 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:29.176988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== disconnect_volume: return (344ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:29.177213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:29.254763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:29.255194 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Cannot resize image /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:39:29.255556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:29.255759 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Ensure instance console log exists: /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:39:29.256067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:29.256290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:29.256439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:29.500999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-74d52f1c-5f45-4ef3-9305-a99c5b635558 req-0f515d68-8c30-45b5-9357-f7dc30637517 service nova] Releasing lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:29.501564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:29.502317 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:29.727497 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'flavor' on Instance uuid 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:30.033316 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d2a0afdf-49df-42a9-b430-11871f7a16ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.033773 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a651c0b4-1267-4e3f-b151-7de64dd9e629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.033773 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.033928 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 98331717-bd7f-486b-ad83-228f6b5e44b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034077 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034218 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034363 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a7a81f92-a39b-4a10-9868-39e256c3bc33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034506 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034630 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:39:30.034932 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:39:30.035126 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:39:28 up 31 min,  2 users,  load average: 6.95, 6.58, 3.66\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_37a8404c7d33468cab5b1fb42b63d221': '2', 'io_workload': '2', 'num_proj_20e394a2d53341d59d512810b2a3dea2': '1', 'num_task_deleting': '1', 'num_proj_e4aa2dbc46bc4fd7bb84c997a0a07ac9': '1', 'num_proj_61f7491c96154009b61199ad430386d3': '1', 'num_proj_3492928cd5f64475bf5572822120dbbc': '1', 'num_proj_bce458cafea74d40af089b430f6b92ce': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_b3eb60c511814747813d717f2e02a441': '2'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:39:30.071748 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:39:30.175772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-fce7c55d-a0fc-479d-b599-1ba629211f08 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.819s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:30.249717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c02cb881-4386-4215-a9b9-46e669bf76eb tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.734s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:30.250922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.628s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:30.251388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:30.251607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:30.251759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:30.254732 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Terminating instance
May 14 03:39:30.284236 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:30.376474 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:30.376618 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:30.376781 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:ec:7d:1a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:30.377327 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Using config drive
May 14 03:39:30.444916 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Updating instance_info_cache with network_info: [{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:30.598707 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:30.598986 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:30.758093 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:39:30.784685 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:30.789079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:30.809798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:30.833743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:30.863960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:30.885128 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:30.949662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:30.949662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance network_info: |[{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:39:30.953748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start _get_guest_xml network_info=[{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:30.956700 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:30.958318 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1952445858', uuid='0c5e5102-cad2-4bc4-bf52-30db6ee74fe7'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729970.9578404) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:30.963085 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:30.964112 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:30.968755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:30.969027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:30.970042 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:30.970438 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:30.970582 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:30.970750 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:30.970906 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:30.971031 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:30.971169 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:30.971378 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:30.971474 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:30.971599 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:30.971771 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:30.972029 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:30.983550 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952445858',display_name='tempest-ServerRescueNegativeTestJSON-server-1952445858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1952445858',id=32,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-s4b7gp6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:28Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=0c5e5102-cad2-4bc4-bf52-30db6ee74fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:30.983764 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:30.984386 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:30.985769 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:31.010255 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:31.010453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:31.010678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:31.010788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:31.010953 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] No waiting events found dispatching network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:31.011100 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59fecc08-85f7-4c88-a1f8-5f7720418d7b req-1c7b2d2b-3e77-48a5-b1cb-c148fc99ee96 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:31.105569 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Creating config drive at /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config
May 14 03:39:31.109545 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:31.116332 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99966710700005 future=<Future at 0x79d0b8159550 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:31.116756 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999229600000035 future=<Future at 0x79d0b8159550 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:31.117064 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99889538399998 future=<Future at 0x79d0b8159550 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:31.119976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6052iex8 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:31.133950 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Instance destroyed successfully.
May 14 03:39:31.137661 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lazy-loading 'resources' on Instance uuid 0a1da0b4-8ee8-47f4-bea2-cff35980e148 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:31.184958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6052iex8" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:31.492181 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <uuid>0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</uuid>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <name>instance-00000020</name>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1952445858</nova:name>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:30</nova:creationTime>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         <nova:port uuid="98fcba70-7fed-4df9-8c59-51793016a49f">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="serial">0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="uuid">0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:36:41:5f"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <target dev="tap98fcba70-7f"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/console.log" append="off"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:31.492181 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Preparing to wait for external event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952445858',display_name='tempest-ServerRescueNegativeTestJSON-server-1952445858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1952445858',id=32,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-s4b7gp6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:28Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=0c5e5102-cad2-4bc4-bf52-30db6ee74fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:39:31.494175 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.497676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8d6458-ffe7-518e-bb28-bc28a588d386', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.498249 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.498978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:31.510501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.515106 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.515334 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98fcba70-7f, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.515768 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98fcba70-7f, col_values=(('qos', UUID('733c6ccc-e103-4a86-86f9-0b0cbb3f26cb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.516005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98fcba70-7f, col_values=(('external_ids', {'iface-id': '98fcba70-7fed-4df9-8c59-51793016a49f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:41:5f', 'vm-uuid': '0c5e5102-cad2-4bc4-bf52-30db6ee74fe7'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.517021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.518461 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:31.535593 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.536853 np0000000741 nova-compute[97948]: INFO os_vif [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f')
May 14 03:39:31.617910 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:39:31.617910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.676s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:31.618360 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:39:31.641913 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1591187327',display_name='tempest-VolumesSnapshotTestJSON-instance-1591187327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumessnapshottestjson-instance-1591187327',id=26,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX2luR7nvt9GsbUijJ0ubCPBRglY3B1tnFmyvT/JVG2A5+iR8VPCJL5PPLxURlN5L4KQyAyefmgpCetazr7B7fW+jAu/l6bIElwKizzLzGMAV+N2w+/DnP+3nhc60CLTQ==',key_name='tempest-keypair-465312200',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:33Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4aa2dbc46bc4fd7bb84c997a0a07ac9',ramdisk_id='',reservation_id='r-y7tqg3ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1729950457',owner_user_name='tempest-VolumesSnapshotTestJSON-1729950457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab6a4d716840acaf09bbecaaa536d4',uuid=0a1da0b4-8ee8-47f4-bea2-cff35980e148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:39:31.642243 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converting VIF {"id": "72681560-8897-42b7-9d0e-88fa09dd982c", "address": "fa:16:3e:5f:58:c9", "network": {"id": "d4f7c619-86e7-471b-aeff-e857787c4736", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2020954072-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4aa2dbc46bc4fd7bb84c997a0a07ac9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72681560-88", "ovs_interfaceid": "72681560-8897-42b7-9d0e-88fa09dd982c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:31.642862 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:31.643131 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:39:31.644484 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.645374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72681560-88, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.647790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.649457 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:31.661979 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.663880 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.664170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dacae246-ac77-445d-9a4a-db18b13ab3ef) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:31.664812 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.665537 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:31.676255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.678369 np0000000741 nova-compute[97948]: INFO os_vif [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:58:c9,bridge_name='br-int',has_traffic_filtering=True,id=72681560-8897-42b7-9d0e-88fa09dd982c,network=Network(d4f7c619-86e7-471b-aeff-e857787c4736),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72681560-88')
May 14 03:39:31.681244 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:31.681622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:31.681799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:31.682160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:31.682467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:31.682619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:31.702339 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.724191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:31.724191 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:31.724191 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:31.724191 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:31.724191 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:31.724509 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:31.724509 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:31.724509 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:31.724509 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:31.724509 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:31.724688 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '82')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:31.724764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:31.724855 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:39:31.725001 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:31.725152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b5c3b87-b9b6-4a1c-8351-0177d44d75b2') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:39:31.725263 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b07985e0>, {}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:31.725421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Disconnecting from: [] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:31.725594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:31.725705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] <== disconnect_volume: return (44ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:31.725809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:31.726121 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Deleting instance files /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148_del
May 14 03:39:31.731190 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Deletion of /opt/stack/data/nova/instances/0a1da0b4-8ee8-47f4-bea2-cff35980e148_del complete
May 14 03:39:31.746414 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.847091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:31.947184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-01d5052e-52f9-4f23-955f-614e3e05669a req-3c6b0e84-dd8f-457e-89dd-3b71b3dd1e1d service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:31.947376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01d5052e-52f9-4f23-955f-614e3e05669a req-3c6b0e84-dd8f-457e-89dd-3b71b3dd1e1d service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:31.947589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01d5052e-52f9-4f23-955f-614e3e05669a req-3c6b0e84-dd8f-457e-89dd-3b71b3dd1e1d service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:31.947756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01d5052e-52f9-4f23-955f-614e3e05669a req-3c6b0e84-dd8f-457e-89dd-3b71b3dd1e1d service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:31.947971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-01d5052e-52f9-4f23-955f-614e3e05669a req-3c6b0e84-dd8f-457e-89dd-3b71b3dd1e1d service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Processing event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:39:32.061783 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:32.069561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:32.077018 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:32.103216 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:32.106568 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:32.239972 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Took 1.48 seconds to destroy the instance on the hypervisor.
May 14 03:39:32.241286 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:39:32.241286 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:39:32.241286 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:39:32.241583 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:32.310082 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:32.604476 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Rebuilding instance
May 14 03:39:32.651001 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729972.6503837, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:32.651204 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Started (Lifecycle Event)
May 14 03:39:32.653188 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:32.657657 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:32.662609 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance spawned successfully.
May 14 03:39:32.664138 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:32.758859 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:33.064633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:33.064633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:33.064633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:36:41:5f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:33.064633 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Using config drive
May 14 03:39:33.088837 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] Acquiring lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] No waiting events found dispatching network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-unplugged-72681560-8897-42b7-9d0e-88fa09dd982c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Received event network-vif-deleted-72681560-8897-42b7-9d0e-88fa09dd982c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:33.090797 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Neutron deleted interface 72681560-8897-42b7-9d0e-88fa09dd982c; detaching it from the instance and deleting it from the info cache
May 14 03:39:33.091830 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:33.154414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:33.158115 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:33.170408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.170547 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.170966 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.171183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.171488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.171776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:33.293708 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:33.525240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:33.570907 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:33.600342 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9abb34c1-da17-4e2c-aa45-ad0198ee56be req-a01a6965-de4d-4bfa-be85-1c92ffdf9920 service nova] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Detach interface failed, port_id=72681560-8897-42b7-9d0e-88fa09dd982c, reason: Instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:39:33.612569 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:39:33.613144 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.16 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:39:33.660804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:33.661094 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729973.6609132, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:33.661225 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Paused (Lifecycle Event)
May 14 03:39:33.678124 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Took 7.61 seconds to spawn the instance on the hypervisor.
May 14 03:39:33.678346 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:33.727252 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Creating config drive at /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config
May 14 03:39:33.730998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz5npjooa {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:33.792245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz5npjooa" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:33.800044 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Took 1.56 seconds to deallocate network for instance.
May 14 03:39:33.805376 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:33.826524 np0000000741 nova-compute[97948]: WARNING nova.volume.cinder [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Attachment 45a59670-5e33-4003-8be5-ce9bef418ef3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 45a59670-5e33-4003-8be5-ce9bef418ef3. (HTTP 404) (Request-ID: req-de347f93-cc5e-4e72-9284-69265e3c5031)
May 14 03:39:33.826804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Took 0.03 seconds to detach 1 volumes for instance.
May 14 03:39:33.833977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:33.964834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:33.978255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.054208 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:34.056383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:34.056607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:34.056798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:34.056948 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:34.057096 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state active and task_state None.
May 14 03:39:34.057884 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:34.058023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:34.058174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:34.058287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:34.058404 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:34.058546 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1b0e6a34-3c51-44bd-89ac-b30a7a15136c req-9282ffb5-6ade-4282-9eca-d26e8c5e0306 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received unexpected event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 for instance with vm_state active and task_state rebuilding.
May 14 03:39:34.130551 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.164671 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:34.179202 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729974.1788588, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:34.179335 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Resumed (Lifecycle Event)
May 14 03:39:34.189814 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Took 13.26 seconds to build instance.
May 14 03:39:34.289375 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance destroyed successfully.
May 14 03:39:34.340113 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:34.340296 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:34.382996 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Detaching volume 93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:39:34.414712 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.451513 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.461956 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attempting to driver detach volume 93a21d9f-3ce6-4706-8db7-b662eee126ea from mountpoint /dev/vdb
May 14 03:39:34.469380 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found disk vdb by alias ua-93a21d9f-3ce6-4706-8db7-b662eee126ea {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:39:34.469538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Attempting to detach device vdb from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:39:34.469926 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <alias name="ua-93a21d9f-3ce6-4706-8db7-b662eee126ea"/>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <serial>93a21d9f-3ce6-4706-8db7-b662eee126ea</serial>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:34.469926 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:39:34.486376 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully detached device vdb from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the persistent domain config.
May 14 03:39:34.490984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:34.490984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:34.490984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:34.543221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.565199 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.572705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:34.685715 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:34.692908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:34.695018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.779s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:34.773099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.284s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:34.775713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:34.776061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:34.805373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:34.805373 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:34.805373 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:34.805373 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:34.805373 np0000000741 nova-compute[97948]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3 (non-flash)
May 14 03:39:34.805373 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:34.805679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:34.805679 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:34.805679 np0000000741 nova-compute[97948]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:34.805679 np0000000741 nova-compute[97948]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:34.805679 np0000000741 nova-compute[97948]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3 (non-flash)
May 14 03:39:34.805679 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:34.805863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3', '83')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:34.805942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '81')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:34.809579 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '82')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:34.811027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81efce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'): ({'sdh'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:34.811358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Removing multipathed devices sdh, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:39:34.811653 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flush multipath device 3300000001d0409bf {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:39:34.849581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:34.898552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:34.929946 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:34.930199 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:34.939508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:39:34.939508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:39:34.940682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:39:34.954043 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:39:34.955471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:34.972054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.004206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260]
May 14 03:39:35.004206 np0000000741 nova-compute[97948]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260] successful.
May 14 03:39:35.004206 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.022523 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.036628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.071495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260]
May 14 03:39:35.071495 np0000000741 nova-compute[97948]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260] successful.
May 14 03:39:35.071495 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.087230 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:35.087452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:35.087557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== disconnect_volume: return (598ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:35.087915 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:35.176322 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:35.176754 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:35.176826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:35.176995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:35.178581 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Processing event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:39:35.178739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:35.178940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:35.179092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:35.179200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:35.179332 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] No waiting events found dispatching network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:35.179455 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-936c5308-ef98-4159-a5e8-5f498a3481a3 req-30475766-5001-47a6-ad07-e16e36ac8830 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received unexpected event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f for instance with vm_state building and task_state spawning.
May 14 03:39:35.196224 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999696159999985 future=<Future at 0x79d0b0226e10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:35.359591 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729975.3591437, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:35.359746 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Started (Lifecycle Event)
May 14 03:39:35.362336 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:35.368164 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:35.371149 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance spawned successfully.
May 14 03:39:35.371629 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:35.435544 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:35.864710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:35.868444 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:35.879299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.879299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.879625 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.879986 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.880201 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.880438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:35.944673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.604s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:36.011856 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Deleted allocations for instance 0a1da0b4-8ee8-47f4-bea2-cff35980e148
May 14 03:39:36.130587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:36.131103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:36.131428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:36.131593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:36.131721 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:36.132574 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-8adc9d9e-98b5-4e6a-be0e-8697cd7d9966 req-4ca8eec2-b6e2-4503-9b1f-d9afce791411 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received unexpected event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 for instance with vm_state active and task_state rebuilding.
May 14 03:39:36.181686 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance destroyed successfully.
May 14 03:39:36.182819 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-ServerActionsTestOtherA-server-42716224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:39Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:39:36.183006 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:36.183802 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:36.184090 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:39:36.185783 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:36.186166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25eed01c-bb, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:36.189686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:36.190922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:36.191651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:36.191991 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffe8371d-2d92-4769-b0fc-62167324550d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:36.192798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:36.193430 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:36.195403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:36.197254 np0000000741 nova-compute[97948]: INFO os_vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb')
May 14 03:39:36.198337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:36.198646 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:36.198826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:36.199152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:36.199490 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:36.199687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:36.223463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:36.223463 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:36.223463 np0000000741 nova-compute[97948]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3 (non-flash)
May 14 03:39:36.223463 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:36.223721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:36.223721 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:36.223721 np0000000741 nova-compute[97948]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3 (non-flash)
May 14 03:39:36.223721 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:36.223875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8251921-7836-4cd0-9ceb-c40bbe656ac3', '83')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:36.223875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:36.224096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:39:36.224096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:36.224222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea') {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 03:39:36.224352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0722660>, {}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:36.224459 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Disconnecting from: [] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:36.224678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:36.224853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== disconnect_volume: return (26ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:36.224979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:36.225291 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Deleting instance files /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0_del
May 14 03:39:36.226169 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Deletion of /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0_del complete
May 14 03:39:36.372914 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:39:36.373203 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729976.3729086, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:36.373203 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Paused (Lifecycle Event)
May 14 03:39:36.389347 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Took 7.65 seconds to spawn the instance on the hypervisor.
May 14 03:39:36.389872 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:36.877964 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:36.882707 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729976.8823216, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:36.882978 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Resumed (Lifecycle Event)
May 14 03:39:36.902091 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Took 15.21 seconds to build instance.
May 14 03:39:37.024817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f209a630-5d5e-4626-8b50-ece9ab5f2b0a tempest-VolumesSnapshotTestJSON-1729950457 tempest-VolumesSnapshotTestJSON-1729950457-project-member] Lock "0a1da0b4-8ee8-47f4-bea2-cff35980e148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.774s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:37.257422 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Booting with volume 93a21d9f-3ce6-4706-8db7-b662eee126ea at /dev/vdb
May 14 03:39:37.322878 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:37.342603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:39:37.369555 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:37.390991 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:37.398310 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:37.406006 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.724s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:37.426938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:39:37.428144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:39:37.441690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:39:37.441690 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:feec:7d1a', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f'] 
May 14 03:39:37.441690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:39:37.441690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:39:37.444390 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:37.444996 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating existing volume attachment record: e61081bd-cc51-422c-91d0-779e4ca1065d {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:39:37.676674 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Rescuing
May 14 03:39:37.677011 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:37.677261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:37.677588 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:37.904357 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] During sync_power_state the instance has a pending task (rescuing). Skip.
May 14 03:39:38.180713 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:38.525663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:38.606080 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:38.789208 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Updating instance_info_cache with network_info: [{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:39.293199 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:39.603552 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:39:39.604038 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating image(s)
May 14 03:39:39.604463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:39.604653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:39.605114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:39.605427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3d1acc09eaf836d39092524c3719e56d452e4627" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:39.605796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3d1acc09eaf836d39092524c3719e56d452e4627" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:39.938458 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:39.942763 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:39.943376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.054527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.part --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.055174 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] 90dea114-1289-407a-a228-c9bda70c7ed1 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:39:40.055950 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:39:40.057124 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.part /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.291453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.part /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.converted" returned: 0 in 0.234s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.299142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.407722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627.converted --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.407722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3d1acc09eaf836d39092524c3719e56d452e4627" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.801s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:40.408078 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:40.420003 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:40.420610 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.524187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.524719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3d1acc09eaf836d39092524c3719e56d452e4627" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:40.525167 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3d1acc09eaf836d39092524c3719e56d452e4627" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:40.525880 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:40.529369 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:40.529835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.619635 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.620299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627,backing_fmt=raw /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.678722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627,backing_fmt=raw /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk 1073741824" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.679419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3d1acc09eaf836d39092524c3719e56d452e4627" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:40.679514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.762336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1acc09eaf836d39092524c3719e56d452e4627 --force-share --output=json" returned: 0 in 0.083s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.762845 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:39:40.763101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:40.858234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:40.858692 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Cannot resize image /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:39:40.859137 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:40.859333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Ensure instance console log exists: /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:39:40.859661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:40.859893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:40.860046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:40.862269 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start _get_guest_xml network_info=[{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T03:30:33Z,direct_url=<?>,disk_format='qcow2',id=90dea114-1289-407a-a228-c9bda70c7ed1,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T03:30:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '98331717-bd7f-486b-ad83-228f6b5e44b0', 'attached_at': '', 'detached_at': '', 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'serial': '93a21d9f-3ce6-4706-8db7-b662eee126ea'}, 'boot_index': None, 'attachment_id': 'e61081bd-cc51-422c-91d0-779e4ca1065d', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:40.865786 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 14 03:39:40.867255 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='90dea114-1289-407a-a228-c9bda70c7ed1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-42716224', uuid='98331717-bd7f-486b-ad83-228f6b5e44b0'), owner=OwnerMeta(userid='71a50ef37e66489cbf8dc1dde0950769', username='tempest-ServerActionsTestOtherA-882285516-project-member', projectid='37a8404c7d33468cab5b1fb42b63d221', projectname='tempest-ServerActionsTestOtherA-882285516'), image=ImageMeta(id='90dea114-1289-407a-a228-c9bda70c7ed1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729980.8668582) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:40.868518 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:40.869045 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:40.869839 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:40.870139 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:40.871177 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:40.871507 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T03:30:33Z,direct_url=<?>,disk_format='qcow2',id=90dea114-1289-407a-a228-c9bda70c7ed1,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T03:30:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:40.871677 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:40.871782 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:40.871904 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:40.871985 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:40.872078 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:40.872243 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:40.872345 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:40.872456 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:40.872554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:40.872932 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:40.872932 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:40.959448 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:40.967478 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:40.985796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:41.096222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:41.103620 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:41.142609 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:41.142845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:41.143038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:41.143845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:41.143845 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] No waiting events found dispatching network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:41.144696 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-457b2d42-0a9a-4a75-ae62-9d2a972f16e9 req-135dc3ff-733f-4a73-854a-58e754ead9b1 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received unexpected event network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f for instance with vm_state active and task_state rescuing.
May 14 03:39:41.192447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:41.274316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:41.298625 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999689537999984 future=<Future at 0x79d0b84cbb90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:41.301483 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance destroyed successfully.
May 14 03:39:41.301972 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:41.396702 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:39:41.397106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:41.397285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:41.551044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:41.551044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:39:41.565151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:41.565776 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:41.566369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:41.566598 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:41.567510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:41.567804 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:41.581168 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:41.581168 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:41.587448 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:41.587448 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:41.597608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea] added
May 14 03:39:41.597608 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:41.597608 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:41.597608 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:41.597608 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:41.597608 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:41.597608 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:41.598030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:41.598116 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:41.598275 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:41.601238 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea] added
May 14 03:39:41.601238 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:41.601238 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:41.601238 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:41.601238 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:41.601238 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:41.601238 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:41.601499 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:41.601688 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:41.601875 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:41.806138 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Attempting rescue
May 14 03:39:41.806654 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:39:41.809895 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:39:41.810013 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Creating image(s)
May 14 03:39:41.810516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:41.810694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:41.811122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:41.811309 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:42.314920 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:42.315481 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:42.320338 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:42.321909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:42.321909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:42.322258 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:42.325803 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:42.326155 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:42.419724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:42.420290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:42.482260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:42.482803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:42.483128 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'migration_context' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:42.598996 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:42.603716 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:42.619050 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:42.619050 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:42.621330 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:42.621330 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.633761 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.639499 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.647469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.647469 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.647469 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:42.647743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.647743 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.647743 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:42.653793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.653793 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.653793 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:42.654016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.654016 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.654016 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:42.684048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260]
May 14 03:39:42.684048 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260] successful.
May 14 03:39:42.684048 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.695859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260]
May 14 03:39:42.695859 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260] successful.
May 14 03:39:42.695859 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.696509 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.707497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:42.714260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.714260 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.714260 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.714260 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.714260 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:42.714525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.714525 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.714525 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.714525 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.714525 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:42.714997 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:42.715183 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:42.716087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('7', '-', '-', 0) found on session 84 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:42.716269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:42.724427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.724427 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.724427 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.724427 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.724427 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:42.724828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.724828 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:42.724828 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.724828 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:42.724828 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:42.724828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:42.725049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:42.725619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('8', '-', '-', 0) found on session 85 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:42.725727 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:42.734935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 84 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:42.735159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:42.752324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 85 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:42.752324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:42.985984 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:42.986443 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:42.987385 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start _get_guest_xml network_info=[{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:36:41:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:42.987668 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:43.228475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:43.229247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:43.230593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:43.230593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:43.230593 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] No waiting events found dispatching network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:43.230818 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2ef275f1-dbb9-4418-93b0-f392ca65aff5 req-9f635393-36ca-401a-8be0-2355437e26f0 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received unexpected event network-vif-unplugged-98fcba70-7fed-4df9-8c59-51793016a49f for instance with vm_state active and task_state rescuing.
May 14 03:39:43.490120 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:43.493738 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:43.495530 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1952445858', uuid='0c5e5102-cad2-4bc4-bf52-30db6ee74fe7'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:36:41:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729983.4950252) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:43.496924 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:43.497377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:43.498464 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:43.498717 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:43.499789 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:43.500129 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:43.500281 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:43.500370 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:43.500518 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:43.500676 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:43.500800 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:43.500973 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:43.501117 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:43.501281 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:43.501435 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:43.501627 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:43.501913 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:43.527777 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:43.567199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:39:44.003907 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:44.029998 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952445858',display_name='tempest-ServerRescueNegativeTestJSON-server-1952445858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1952445858',id=32,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:36Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-s4b7gp6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:36Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=0c5e5102-cad2-4bc4-bf52-30db6ee74fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:36:41:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:44.030262 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:36:41:5f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:44.031065 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:44.032715 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:44.534607 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:44.535626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <uuid>0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</uuid>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <name>instance-00000020</name>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1952445858</nova:name>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:43</nova:creationTime>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         <nova:port uuid="98fcba70-7fed-4df9-8c59-51793016a49f">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="serial">0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="uuid">0c5e5102-cad2-4bc4-bf52-30db6ee74fe7</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config.rescue"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:36:41:5f"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <target dev="tap98fcba70-7f"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/console.log" append="off"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:44.535626 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:44.541748 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance destroyed successfully.
May 14 03:39:44.584104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found WWN 3300000001d0409bf for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:39:44.584104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:44.584104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== connect_volume: return (3186ms) {'type': 'block', 'scsi_wwn': '3300000001d0409bf', 'path': '/dev/dm-0', 'multipath_id': '3300000001d0409bf'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:44.584330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001d0409bf', 'path': '/dev/dm-0', 'multipath_id': '3300000001d0409bf'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:39:45.089592 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-ServerActionsTestOtherA-server-42716224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:39Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:45.090128 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:45.090458 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:45.092007 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] End _get_guest_xml xml=<domain type="qemu">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <uuid>98331717-bd7f-486b-ad83-228f6b5e44b0</uuid>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <name>instance-0000001b</name>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherA-server-42716224</nova:name>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:40</nova:creationTime>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:image uuid="90dea114-1289-407a-a228-c9bda70c7ed1">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:user uuid="71a50ef37e66489cbf8dc1dde0950769">tempest-ServerActionsTestOtherA-882285516-project-member</nova:user>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:project uuid="37a8404c7d33468cab5b1fb42b63d221">tempest-ServerActionsTestOtherA-882285516</nova:project>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="90dea114-1289-407a-a228-c9bda70c7ed1"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         <nova:port uuid="25eed01c-bba3-479b-af55-d34503546124">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <system>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="serial">98331717-bd7f-486b-ad83-228f6b5e44b0</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="uuid">98331717-bd7f-486b-ad83-228f6b5e44b0</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </system>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <os>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </os>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <features>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </features>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   <devices>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <alias name="ua-93a21d9f-3ce6-4706-8db7-b662eee126ea"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <serial>93a21d9f-3ce6-4706-8db7-b662eee126ea</serial>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </disk>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:63:95:d2"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <target dev="tap25eed01c-bb"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </interface>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/console.log" append="off"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </serial>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <video>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </video>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </rng>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:   </devices>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]: </domain>
May 14 03:39:45.092007 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:39:45.094994 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-ServerActionsTestOtherA-server-42716224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:39Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:39:45.094994 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:45.094994 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:45.096437 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:39:45.096437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.096437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:45.096437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:39:45.098730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.098966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7859b11-1810-58ad-857f-601fa581ad35', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:45.099743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.100633 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:45.108798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.110979 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.111189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25eed01c-bb, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:45.111560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25eed01c-bb, col_values=(('qos', UUID('f4cc0824-e49c-4e56-a777-e7e6fb72c9d2')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:45.111811 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25eed01c-bb, col_values=(('external_ids', {'iface-id': '25eed01c-bba3-479b-af55-d34503546124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:95:d2', 'vm-uuid': '98331717-bd7f-486b-ad83-228f6b5e44b0'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:45.112798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.114324 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:45.126786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:45.128137 np0000000741 nova-compute[97948]: INFO os_vif [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb')
May 14 03:39:45.190476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:45.190760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:45.694574 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:46.058867 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.059030 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.059374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.059514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:36:41:5f, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:46.060106 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Using config drive
May 14 03:39:46.116631 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005639650000830443 future=<Future at 0x79d0b8159550 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:46.117100 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:46.117100 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.07909028500012 future=<Future at 0x79d0b0226e10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:46.117100 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.079024674000038 future=<Future at 0x79d0b0226e10 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:46.117453 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778729971.1158776, 0a1da0b4-8ee8-47f4-bea2-cff35980e148 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:46.117754 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] VM Stopped (Lifecycle Event)
May 14 03:39:46.142228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:46.142793 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:46.563001 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:46.620369 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 0a1da0b4-8ee8-47f4-bea2-cff35980e148] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:46.647308 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Detaching volume b85b1681-7b37-473e-91a4-f735d3a371ee
May 14 03:39:46.651745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.651899 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.652004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:46.652129 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:63:95:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:46.656509 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Using config drive
May 14 03:39:46.700363 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Attempting to driver detach volume b85b1681-7b37-473e-91a4-f735d3a371ee from mountpoint /dev/vdb
May 14 03:39:46.700929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:46.707243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found disk vdb by alias ua-b85b1681-7b37-473e-91a4-f735d3a371ee {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:39:46.708320 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Found disk vdb by alias ua-b85b1681-7b37-473e-91a4-f735d3a371ee {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:39:46.708444 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Attempting to detach device vdb from instance a651c0b4-1267-4e3f-b151-7de64dd9e629 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:39:46.708746 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <alias name="ua-b85b1681-7b37-473e-91a4-f735d3a371ee"/>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <serial>b85b1681-7b37-473e-91a4-f735d3a371ee</serial>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:46.708746 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:39:46.715906 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully detached device vdb from instance a651c0b4-1267-4e3f-b151-7de64dd9e629 from the persistent domain config.
May 14 03:39:46.716039 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] (1/8): Attempting to detach device vdb with device alias ua-b85b1681-7b37-473e-91a4-f735d3a371ee from instance a651c0b4-1267-4e3f-b151-7de64dd9e629 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:39:46.716307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <alias name="ua-b85b1681-7b37-473e-91a4-f735d3a371ee"/>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <serial>b85b1681-7b37-473e-91a4-f735d3a371ee</serial>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:46.716307 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:39:47.066161 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:47.066355 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'keypairs' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:47.159376 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'ec2_ids' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:47.278947 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778729987.278418, a651c0b4-1267-4e3f-b151-7de64dd9e629 => ua-b85b1681-7b37-473e-91a4-f735d3a371ee> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:39:47.281958 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b85b1681-7b37-473e-91a4-f735d3a371ee for instance a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:39:47.290974 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully detached device vdb from instance a651c0b4-1267-4e3f-b151-7de64dd9e629 from the live domain config.
May 14 03:39:47.292461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:39:47.292927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:47.293109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:47.293554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:47.293949 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85b1681-7b37-473e-91a4-f735d3a371ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:39:47.294452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:39:47.319032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:47.319032 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:47.319032 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:47.319032 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:47.319032 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:47.319214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:47.319214 np0000000741 nova-compute[97948]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee (non-flash)
May 14 03:39:47.319214 np0000000741 nova-compute[97948]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:47.319214 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:47.319214 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:47.319410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '85')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:39:47.319514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '76')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:47.320535 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee', '75')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:39:47.321492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b077c180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:39:47.321868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:39:47.322142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Flush multipath device 330000000f1b8c649 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:39:47.355293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:47.392415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:39:47.433178 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:39:47.433707 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:39:47.434222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:39:47.445980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:39:47.446201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:39:47.459339 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.494232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.40.100,3260]
May 14 03:39:47.494232 np0000000741 nova-compute[97948]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.40.100,3260] successful.
May 14 03:39:47.494232 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.507099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.518333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.545363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.50.100,3260]
May 14 03:39:47.545363 np0000000741 nova-compute[97948]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-b85b1681-7b37-473e-91a4-f735d3a371ee, portal: 192.168.50.100,3260] successful.
May 14 03:39:47.545363 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.562021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:47.562353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:47.562598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] <== disconnect_volume: return (269ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:47.562813 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:39:47.569050 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<0c5e5102-cad2-4bc4-bf52-30db6ee74fe7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:47.571669 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:47.663731 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Object Instance<98331717-bd7f-486b-ad83-228f6b5e44b0> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:47.663938 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'keypairs' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:47.694346 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Creating config drive at /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config.rescue
May 14 03:39:47.697808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcwt1t7kz {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:47.749656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcwt1t7kz" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:47.829566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:47.829566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:47.829566 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Attaching volume 14d3512e-5443-48f9-9893-d251c448c92e to /dev/vdb
May 14 03:39:47.890172 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:47.900511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:39:47.923552 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:47.964605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:39:47.964937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:39:47.974282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:39:47.975720 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5a:c5d2', 'fe80::dcda:b7ff:fe86:1772', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:feec:7d1a', 'fe80::f07d:d6ff:fecb:27ff'] 
May 14 03:39:47.975860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:39:47.975946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:39:47.976169 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:47.976393 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updating existing volume attachment record: 041a6db9-f196-4f50-8489-a15c5e00daa0 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:39:48.123535 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'flavor' on Instance uuid a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:48.167457 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Object Instance<98331717-bd7f-486b-ad83-228f6b5e44b0> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:48.171059 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 14 03:39:48.287856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.329025 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.339021 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Creating config drive at /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config
May 14 03:39:48.343703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu5k4piue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:48.403414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu5k4piue" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:48.429062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.453056 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.459714 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.529398 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:48.540290 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:48.541207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:48.543712 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:48.544404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:48.544667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] No waiting events found dispatching network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:48.545244 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-99e25006-288a-4bb0-b93f-a76539fdff09 req-a3df312e-085b-483e-9578-87c30a57ac50 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received unexpected event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f for instance with vm_state active and task_state rescuing.
May 14 03:39:48.549702 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:39:48.550155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:48.550297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:48.551013 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:48.551605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:39:48.565383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:48.566389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:48.566715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:48.566715 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:48.567292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:48.567292 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:48.584394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:48.584394 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:48.590572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:48.590572 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:48.603186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e] added
May 14 03:39:48.603186 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:48.603186 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:48.603186 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:48.603186 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:48.603186 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:48.603186 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:48.603460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:48.603524 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:48.604240 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e] added
May 14 03:39:48.610501 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:48.610501 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:48.610501 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0436(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:48.611795 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:48.984468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.021214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.025687 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.128887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.136559 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dcf59a8-06a9-4d32-8241-ad9b93cdef7b tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.994s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:49.160200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.162827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.322986 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:49.323460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:49.323460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:49.323713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:49.323778 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:49.323933 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-ad20450c-027f-415b-9946-fef617e489db req-f9b128f9-3e78-4f3b-bcc4-79881386f4e6 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received unexpected event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 for instance with vm_state active and task_state rebuild_spawning.
May 14 03:39:49.441263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:49.441263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:49.441263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:49.441263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:49.441263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:49.442654 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Terminating instance
May 14 03:39:49.604214 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:49.611296 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:49.624607 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:49.624607 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:49.635328 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:49.635328 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.647106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.656580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.674326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.674326 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.674326 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:49.674732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.674732 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.674732 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:49.688333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.688333 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.688333 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:49.688584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.688584 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.688584 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:49.708172 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.40.100,3260]
May 14 03:39:49.708172 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.40.100,3260] successful.
May 14 03:39:49.708172 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.723255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.730060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.50.100,3260]
May 14 03:39:49.730060 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.50.100,3260] successful.
May 14 03:39:49.730060 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.742165 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('9', '-', '-', 0) found on session 86 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:49.742165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:49.750276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:49.773371 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('10', '-', '-', 0) found on session 87 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:49.773371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:49.776203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 86 and hctl ['9', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:49.807614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 87 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:49.807827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:49.836067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:49.836067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:49.899467 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 due to new event <LifecycleEvent: 1778729989.8990467, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:39:49.899698 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729989.8990467, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:49.900436 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Resumed (Lifecycle Event)
May 14 03:39:49.904603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f20da46f-08d0-4a5a-b2d8-732b8b52a110 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:49.947873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:39:49.981039 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:49.991613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.011193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.041928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.075238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.123391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.179118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:39:50.179336 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:39:50.183915 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance spawned successfully.
May 14 03:39:50.184421 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:39:50.196690 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00045925900008114695 future=<Future at 0x79d0b0226e10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:50.197381 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778729975.1958117, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:50.197804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Stopped (Lifecycle Event)
May 14 03:39:50.199431 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:50.199691 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.09866534899993 future=<Future at 0x79d0b84cbb90 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:50.199759 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.098518829000113 future=<Future at 0x79d0b84cbb90 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:50.199847 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:50.343696 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:50.345097 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Instance destroyed successfully.
May 14 03:39:50.346509 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lazy-loading 'resources' on Instance uuid a651c0b4-1267-4e3f-b151-7de64dd9e629 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:50.407182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:50.410913 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:50.605051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:50.605205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:50.605371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:50.605502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:50.605614 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] No waiting events found dispatching network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:50.605818 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6943f7c5-bebf-4a12-a2e6-16209d86ec7a req-9dea1c88-a2e5-46f6-bd43-9556ed7f4130 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received unexpected event network-vif-plugged-98fcba70-7fed-4df9-8c59-51793016a49f for instance with vm_state rescued and task_state None.
May 14 03:39:50.690990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.691087 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.691491 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.691767 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.692145 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.692381 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:39:50.701725 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-601cf269-6041-4902-b55a-204d0a563ee7 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:50.778054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 86 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:50.778219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:50.849360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1619237265',display_name='tempest-VolumesBackupsTest-instance-1619237265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesbackupstest-instance-1619237265',id=25,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjV5jRKTvzn+Ps9WhLG8hkh+ZPmN9afzpwylKxykfHIM602vqCYYJdL6JR/lovL/RcYQWVzvas4fF/3jxLWlHQ8JpTjXus509ErlqzfwDOYZYugEQyGmiI7HieFsWozuw==',key_name='tempest-keypair-558955526',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:38:12Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20e394a2d53341d59d512810b2a3dea2',ramdisk_id='',reservation_id='r-qr8hj4et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-645442672',owner_user_name='tempest-VolumesBackupsTest-645442672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c969f8c1275340d3b8a0bbcb62a497ed',uuid=a651c0b4-1267-4e3f-b151-7de64dd9e629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:39:50.850206 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converting VIF {"id": "2be556a8-b19b-4ddf-812e-c0f027583c01", "address": "fa:16:3e:5a:c5:d2", "network": {"id": "c170c493-df4c-4f09-8e9b-c1bfebd792e7", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1141976354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20e394a2d53341d59d512810b2a3dea2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be556a8-b1", "ovs_interfaceid": "2be556a8-b19b-4ddf-812e-c0f027583c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:50.850974 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:50.851274 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:39:50.854510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.854796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2be556a8-b1, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:50.856793 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.858722 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:50.860929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.861206 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7886eed-8298-413c-90ff-e9d423a1a418) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:39:50.865144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:50.866375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:39:50.872070 np0000000741 nova-compute[97948]: INFO os_vif [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c5:d2,bridge_name='br-int',has_traffic_filtering=True,id=2be556a8-b19b-4ddf-812e-c0f027583c01,network=Network(c170c493-df4c-4f09-8e9b-c1bfebd792e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be556a8-b1')
May 14 03:39:50.872331 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Deleting instance files /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629_del
May 14 03:39:50.873082 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Deletion of /opt/stack/data/nova/instances/a651c0b4-1267-4e3f-b151-7de64dd9e629_del complete
May 14 03:39:50.914777 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729990.9144802, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:50.914967 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Started (Lifecycle Event)
May 14 03:39:51.197582 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:51.352658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:51.379256 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Took 1.43 seconds to destroy the instance on the hypervisor.
May 14 03:39:51.379893 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:39:51.380227 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:39:51.380365 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:39:51.380683 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:51.399249 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:51.399417 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:51.399802 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:51.399802 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:51.402749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:51.403619 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received unexpected event network-vif-plugged-25eed01c-bba3-479b-af55-d34503546124 for instance with vm_state active and task_state None.
May 14 03:39:51.403753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:51.403899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:51.404051 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:51.404148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:51.404246 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] No waiting events found dispatching network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:51.404350 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:51.404490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:51.404609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Acquiring lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:51.404739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:51.404846 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:51.404977 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] No waiting events found dispatching network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:51.405115 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8366f605-92f6-4b3f-b42b-611010a3f7e5 req-eb22d7d2-138a-4089-a73e-9ba2a877e45a service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-unplugged-2be556a8-b19b-4ddf-812e-c0f027583c01 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:39:51.417623 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:51.419561 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:51.499484 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:51.582198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found WWN 330000000084a6c8d for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:39:51.582577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:51.582850 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000084a6c8d', 'path': '/dev/dm-1', 'multipath_id': '330000000084a6c8d'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:51.583124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000084a6c8d', 'path': '/dev/dm-1', 'multipath_id': '330000000084a6c8d'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:39:51.590371 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:51.715213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:51.715426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:51.715882 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97948) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 14 03:39:51.925665 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729991.9253373, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:51.926923 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Resumed (Lifecycle Event)
May 14 03:39:52.099226 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Attempting to attach volume 14d3512e-5443-48f9-9893-d251c448c92e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:39:52.100377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:   <alias name="ua-14d3512e-5443-48f9-9893-d251c448c92e"/>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:   <serial>14d3512e-5443-48f9-9893-d251c448c92e</serial>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:52.100377 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:39:52.432147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:52.434337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:52.454000 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:52.492623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:52.492885 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:52.493123 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attaching volume d6b6605e-28bc-486f-a8d3-77d2310a7a03 to /dev/vdb
May 14 03:39:52.536100 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:52.548298 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:39:52.573384 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:52.619541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:39:52.619860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:39:52.629572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:39:52.631209 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:feec:7d1a', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:fe63:95d2'] 
May 14 03:39:52.631403 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:39:52.631517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:39:52.631819 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:52.632131 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating existing volume attachment record: c66eb2ec-bc33-4835-8576-bf90ee5c8b39 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:39:52.674019 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-502b4773-98da-405d-b3ba-56785c35568d req-9e0bf8e1-eb03-46c8-ba9e-bea50fd756ec service nova] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Received event network-vif-deleted-2be556a8-b19b-4ddf-812e-c0f027583c01 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:52.729481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7605525b-2ee8-445d-bfcb-79937de6d513 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.014s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:52.937058 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778729992.9366841, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:39:52.937215 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Started (Lifecycle Event)
May 14 03:39:52.956494 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Took 1.58 seconds to deallocate network for instance.
May 14 03:39:53.199772 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:39:53.200061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:39:53.200196 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:53.200616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:53.200831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:39:53.212797 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:53.213584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:39:53.214718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:53.215140 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:53.215528 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:39:53.215672 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:53.228453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:53.228453 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:53.234443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:39:53.234443 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:53.243235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03] added
May 14 03:39:53.243235 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:53.243235 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:53.243235 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:53.243235 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:53.243235 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:53.243235 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:53.243531 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:53.243608 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0279(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:53.243778 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:53.245749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03] added
May 14 03:39:53.245749 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:39:53.245749 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:53.245749 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:53.245749 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:39:53.245749 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:39:53.245749 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:53.245903 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:39:53.246085 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:39:53.246230 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:39:53.439552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:39:53.441159 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:39:53.455583 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Rescuing
May 14 03:39:53.455713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:39:53.455767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:39:53.455905 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:39:53.462268 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:53.462472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:53.533799 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:53.789508 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:53.789717 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:53.789767 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:53.790529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:5b:c8:ff, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:53.943429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:39:53.943963 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:39:53.946278 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999598419999984 future=<Future at 0x79d0b0785640 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:53.946591 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998990108000044 future=<Future at 0x79d0b0785640 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:53.946729 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998867482999913 future=<Future at 0x79d0b0785640 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:53.958049 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:54.244325 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:39:54.246668 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:54.258486 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:54.258486 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:39:54.267547 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:39:54.267547 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.282589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.285205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.302658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.302658 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.302658 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.302658 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.302658 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:54.302949 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.302949 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.302949 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.302949 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.302949 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:54.310345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.310345 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.310345 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.310345 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.310345 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:54.310565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.310565 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.310565 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.310565 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.310565 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:54.344811 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.50.100,3260]
May 14 03:39:54.344811 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.50.100,3260] successful.
May 14 03:39:54.344811 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.359761 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.360345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.40.100,3260]
May 14 03:39:54.360345 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.40.100,3260] successful.
May 14 03:39:54.360345 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.376207 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:39:54.379349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.381099 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.381351 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:54.381764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:54.381764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:54.382866 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('11', '-', '-', 0) found on session 88 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:54.383668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.397130 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:39:54.405470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 88 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:54.405470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:54.408217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('12', '-', '-', 0) found on session 89 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:39:54.408217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:39:54.422726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:39:54.422726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:39:54.449604 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:39:54.559240 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:39:54.958506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.496s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:55.007205 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Deleted allocations for instance a651c0b4-1267-4e3f-b151-7de64dd9e629
May 14 03:39:55.010553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:55.061945 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:39:55.216886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:39:55.347412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d7f7c1e4-2410-46a1-95ea-72b46d0a39c9 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.518s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:55.865175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:56.020107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbc6bd45-43c5-4fe1-b94f-8f365647343c tempest-VolumesBackupsTest-645442672 tempest-VolumesBackupsTest-645442672-project-member] Lock "a651c0b4-1267-4e3f-b151-7de64dd9e629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.581s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:56.235793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found WWN 330000000d55db966 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:39:56.235793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:39:56.235793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000d55db966', 'path': '/dev/dm-2', 'multipath_id': '330000000d55db966'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:39:56.235793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d55db966', 'path': '/dev/dm-2', 'multipath_id': '330000000d55db966'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:39:56.239671 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:56.696922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:56.701180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:56.724683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:56.742500 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attempting to attach volume d6b6605e-28bc-486f-a8d3-77d2310a7a03 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:39:56.745169 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:   <alias name="ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03"/>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:   <serial>d6b6605e-28bc-486f-a8d3-77d2310a7a03</serial>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]: </disk>
May 14 03:39:56.745169 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:39:56.890559 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:56.896839 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:57.020394 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:57.052237 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99970193099989 future=<Future at 0x79d0b0199a60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:57.056307 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance destroyed successfully.
May 14 03:39:57.056307 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:57.116766 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:57.117077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:57.117229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:57.117396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:57.117570 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:57.117731 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5f23b1a0-b28f-4c63-a38f-0b70bedde043 req-5df0bebf-70d2-40c4-8785-ce44134cc7d7 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state active and task_state rescuing.
May 14 03:39:57.152176 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:57.152388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:57.152526 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Shelving
May 14 03:39:57.562001 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Attempting rescue
May 14 03:39:57.562001 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:39:57.566668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:39:57.567054 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Creating image(s)
May 14 03:39:57.567940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:57.568534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:57.569180 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:57.570083 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:58.028417 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:58.028880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:58.071147 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:58.074659 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:58.075909 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:58.077389 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:58.077947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:58.078301 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:58.082168 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:39:58.082653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:58.190992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:58.194812 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:39:58.209833 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.230960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.238096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.269838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.rescue" returned: 0 in 0.078s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:39:58.272265 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.272950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:58.274283 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'migration_context' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:58.445969 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:58.446155 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:58.446238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:39:58.446403 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:54:94:99, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:39:58.483000 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.499479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.509681 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999648621999995 future=<Future at 0x79d0b0188800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:39:58.512504 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance destroyed successfully.
May 14 03:39:58.514501 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'numa_topology' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:58.517629 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:58.517770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:58.518724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:58.518942 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:58.519107 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:58.519297 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-617f4a1a-0672-4a7a-82d1-6c70e10efa40 req-c5479920-ddad-4ed8-ab5b-a0cfa31f3586 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received unexpected event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with vm_state active and task_state shelving.
May 14 03:39:58.530578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:39:58.535960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:58.781862 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:58.782401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:39:58.783133 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start _get_guest_xml network_info=[{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:ec:7d:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:39:58.783397 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:59.125668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:59.126452 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:59.130555 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:39:59.132781 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Claim successful on node np0000000741
May 14 03:39:59.180507 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Beginning cold snapshot process
May 14 03:39:59.205076 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:39:59.208676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:39:59.208676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:39:59.208676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:39:59.208676 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:39:59.208676 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6855fc01-9982-4d56-a138-cf3d1bac702c req-9e371499-6112-4eaf-a456-20d04e06ad44 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state active and task_state rescuing.
May 14 03:39:59.288022 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:59.288748 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:39:59.296837 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1705297539', uuid='1c7ec2de-3093-4b9c-9b5b-58aad8cf125c'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:ec:7d:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778729999.289913) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:39:59.296837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:39:59.296837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:39:59.296837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:39:59.296837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:39:59.299469 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:39:59.300666 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:39:59.300883 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:39:59.302344 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:39:59.302603 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:39:59.302864 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:39:59.302916 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:39:59.303259 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:39:59.303484 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:39:59.303980 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:39:59.303980 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:39:59.304103 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:39:59.304373 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:39:59.365371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:39:59.809939 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:39:59.832281 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1705297539',display_name='tempest-ServerRescueNegativeTestJSON-server-1705297539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1705297539',id=31,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:33Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-waw0p200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:39:34Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=1c7ec2de-3093-4b9c-9b5b-58aad8cf125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:ec:7d:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:39:59.832518 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:ec:7d:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:39:59.833267 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:39:59.833990 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:00.009510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2bf45ff2-e45b-4cb2-8199-eaaea369af92 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.516s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:00.335898 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:00.337089 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <uuid>1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</uuid>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <name>instance-0000001f</name>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1705297539</nova:name>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:39:59</nova:creationTime>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         <nova:port uuid="decbf6dd-5954-4ec6-8e05-f7397f8b9453">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="serial">1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="uuid">1c7ec2de-3093-4b9c-9b5b-58aad8cf125c</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.rescue"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config.rescue"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:ec:7d:1a"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <target dev="tapdecbf6dd-59"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/console.log" append="off"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:00.337089 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:00.342423 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance destroyed successfully.
May 14 03:40:00.407051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:00.603142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:00.603353 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:00.603554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:00.603737 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:00.603897 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:00.604049 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-892e641d-fb67-4970-bbc0-8ac213902e67 req-6a51ed65-5068-4aa1-bec4-15be02246962 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received unexpected event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with vm_state active and task_state shelving_image_pending_upload.
May 14 03:40:00.679603 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:00.679864 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:00.698952 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:40:00.699270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk /opt/stack/data/nova/instances/snapshots/tmp0ruck_mw/d4afd1f13db749aa9bf0adb7f12c489e {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:00.867615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:00.994108 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk /opt/stack/data/nova/instances/snapshots/tmp0ruck_mw/d4afd1f13db749aa9bf0adb7f12c489e" returned: 0 in 0.295s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:00.994478 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Snapshot extracted, beginning image upload
May 14 03:40:01.184266 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:01.304201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:01.304566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:01.695024 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.568s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:01.695536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:01.728104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:01.811665 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:01.870004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:01.870004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:01.870321 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:01.870837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:ec:7d:1a, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:01.871565 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Using config drive
May 14 03:40:02.205596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:40:02.205596 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:40:02.205943 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:02.206283 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:02.289113 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba9e32f212f04cae8a70c44b26647a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f7491c96154009b61199ad430386d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:40:02.381867 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'ec2_ids' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:02.709095 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:40:02.821142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:02.868732 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Successfully created port: d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:40:02.892388 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:02.892388 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'keypairs' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:03.213170 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:40:03.394825 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:03.397723 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:03.541836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:03.642953 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Successfully updated port: d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:40:03.801549 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Creating config drive at /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config.rescue
May 14 03:40:03.823103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu3usp1b7 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:03.825893 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-changed-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:03.825893 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Refreshing instance network info cache due to event network-changed-d723f939-352b-42ab-adba-3e7b36e21bbe. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:03.825893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] Acquiring lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:03.825893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] Acquired lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:03.825893 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Refreshing network info cache for port d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:03.911649 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu3usp1b7" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:03.941456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:03.942004 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:03.942199 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attaching volume ebaa470d-edc2-4620-ab84-c3d970a089f2 to /dev/vdc
May 14 03:40:04.005197 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:04.019179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:40:04.051778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.118893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:40:04.119948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:40:04.131863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:40:04.134085 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:fe63:95d2'] 
May 14 03:40:04.134538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:40:04.134892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:40:04.135520 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:04.136110 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating existing volume attachment record: a09423cf-0ee2-46a0-8f15-83268afaa057 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:40:04.149156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:04.229574 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:40:04.231232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:04.231503 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Creating image(s)
May 14 03:40:04.232012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:04.232174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:04.233112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:04.233671 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:04.237178 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:04.238993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.337587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:04.338809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:04.340816 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:04.341847 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:04.346860 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:04.347235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.348516 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:04.442173 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Snapshot image upload complete
May 14 03:40:04.442524 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:04.454552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.488123 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.491223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.495432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.148s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:04.495929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.517974 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:04.572895 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk 1073741824" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:04.573289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:04.573630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.612492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.615895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.627375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:04.701549 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.128s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:04.704335 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:40:04.704906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:04.749904 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:40:04.750704 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:04.751359 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:04.752420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:04.752836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:40:04.769130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:04.769497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:04.769816 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:04.773337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:04.773784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:04.773993 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:04.795333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:04.795333 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2] added
May 14 03:40:04.810063 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:04.810063 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:04.810063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:04.811708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:04.811708 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:04.812017 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:04.815710 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:04.821565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:04.821867 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:04.822066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:04.822236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:04.822462 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:04.825948 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-025eb19a-9ad1-46c2-8d40-e25cefbf91a6 req-50b5cd41-85f5-42c3-b1f3-6920045aeffc service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state active and task_state rescuing.
May 14 03:40:04.828853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2] added
May 14 03:40:04.828853 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:04.828853 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:04.828853 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:04.828853 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:04.828853 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:04.828853 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:04.829116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:04.829166 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0552(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:04.829325 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:04.844535 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:04.862461 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:04.862632 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Cannot resize image /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:40:04.866770 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:40:04.866770 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:04.866770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:04.866995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:04.867063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:04.966527 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Shelve offloading
May 14 03:40:05.346879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffdef06f-bab5-4c0e-8bd0-4960abb87114 req-ba4749ca-a718-43da-afdc-1195b7f1ce42 service nova] Releasing lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:05.347355 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquired lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:05.347540 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:05.466183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c due to new event <LifecycleEvent: 1778730005.4658022, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:40:05.466392 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730005.4658022, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:05.466516 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Resumed (Lifecycle Event)
May 14 03:40:05.468901 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-80a12ced-ccfe-438d-a592-aac9945e4f41 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:05.479821 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance destroyed successfully.
May 14 03:40:05.480322 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:05.483433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:05.483616 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:05.483785 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:05.816055 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:05.827619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:05.829868 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:05.832038 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:05.832038 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:05.848151 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:05.848151 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.854111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.860325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.868680 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.869988 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.871006 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.881352 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.881616 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:05.922764 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:05.925055 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.40.100,3260]
May 14 03:40:05.925055 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.40.100,3260] successful.
May 14 03:40:05.925055 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.940136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.941730 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.50.100,3260]
May 14 03:40:05.941730 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.50.100,3260] successful.
May 14 03:40:05.941730 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.959828 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:05.959828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:05.961290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:05.962594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('13', '-', '-', 0) found on session 90 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:05.962744 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:05.975410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:05.982151 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:05.982151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:05.983239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] HCTL ('14', '-', '-', 0) found on session 91 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:05.983471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:05.990042 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:05.998564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:06.003510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 90 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:06.003510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:06.008180 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Searching for a device in session 91 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:06.008180 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:06.240521 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:06.462873 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updating instance_info_cache with network_info: [{"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:06.501578 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730006.501305, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:06.501767 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Started (Lifecycle Event)
May 14 03:40:06.510285 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:06.688599 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:06.774432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:06.899501 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-91d6dfd0-0037-459e-858b-0397eb97c5ea req-1ae82ee2-1fb6-430f-8920-92ddf4fda646 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state rescued and task_state unrescuing.
May 14 03:40:06.965294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Releasing lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:06.966043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance network_info: |[{"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:40:06.969048 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Start _get_guest_xml network_info=[{"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:06.974076 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:06.975652 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1271288932', uuid='76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9'), owner=OwnerMeta(userid='ba9e32f212f04cae8a70c44b26647a59', username='tempest-AttachVolumeNegativeTest-1381632340-project-member', projectid='61f7491c96154009b61199ad430386d3', projectname='tempest-AttachVolumeNegativeTest-1381632340'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730006.9750078) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:06.980525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:06.980525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:06.982427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:06.982626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:06.983772 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:06.987703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:06.988301 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:07.006961 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:07.008518 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1271288932',display_name='tempest-AttachVolumeNegativeTest-server-1271288932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1271288932',id=33,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu1pSuZMV80gA0k0gv4S54IjootF5C+ysO3nTIFo0VuIhg2ZazzDEmxXJYpYL8Btfd1BEcG9qqvnbweO7foc4liadYYZ+TVRALqdWgulcB/zOAjp1UnwDOj2tW4Y6OkwQ==',key_name='tempest-keypair-169325770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-pj9df8ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:07.008771 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:07.009468 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:07.010542 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:07.011689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:07.162399 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Unrescuing
May 14 03:40:07.162399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:07.162399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:07.162399 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:07.191401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:07.191853 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:07.192161 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:07.480987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:07.481745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:07.514295 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:40:07.514730 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <uuid>76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9</uuid>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <name>instance-00000021</name>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1271288932</nova:name>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:06</nova:creationTime>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:user uuid="ba9e32f212f04cae8a70c44b26647a59">tempest-AttachVolumeNegativeTest-1381632340-project-member</nova:user>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:project uuid="61f7491c96154009b61199ad430386d3">tempest-AttachVolumeNegativeTest-1381632340</nova:project>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         <nova:port uuid="d723f939-352b-42ab-adba-3e7b36e21bbe">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="serial">76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="uuid">76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.config"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:08:12:7d"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <target dev="tapd723f939-35"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/console.log" append="off"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:07.514730 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:07.516606 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Preparing to wait for external event network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:07.516606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:07.516606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:07.516733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:07.517460 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1271288932',display_name='tempest-AttachVolumeNegativeTest-server-1271288932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1271288932',id=33,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu1pSuZMV80gA0k0gv4S54IjootF5C+ysO3nTIFo0VuIhg2ZazzDEmxXJYpYL8Btfd1BEcG9qqvnbweO7foc4liadYYZ+TVRALqdWgulcB/zOAjp1UnwDOj2tW4Y6OkwQ==',key_name='tempest-keypair-169325770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-pj9df8ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:07.517663 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:07.518238 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:07.518696 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:07.519626 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.519626 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:07.519626 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:07.521423 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.521423 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03bbb0ef-f267-5f08-8f4f-f0414ebe3a40', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:07.522314 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:07.529560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.538302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.538302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd723f939-35, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:07.538302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd723f939-35, col_values=(('qos', UUID('307f0c7c-25f7-44c8-9c5e-9e454cba6eb2')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:07.538302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd723f939-35, col_values=(('external_ids', {'iface-id': 'd723f939-352b-42ab-adba-3e7b36e21bbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:12:7d', 'vm-uuid': '76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:07.539763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.541566 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:07.551660 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:07.552907 np0000000741 nova-compute[97948]: INFO os_vif [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35')
May 14 03:40:07.664231 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:07.795612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found WWN 3300000001c8aa892 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:40:07.795822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:07.796051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000001c8aa892', 'path': '/dev/dm-3', 'multipath_id': '3300000001c8aa892'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:07.796227 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001c8aa892', 'path': '/dev/dm-3', 'multipath_id': '3300000001c8aa892'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:40:07.800729 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:07.823521 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance destroyed successfully.
May 14 03:40:07.825260 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'resources' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:07.873797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:07.874016 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing instance network info cache due to event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:07.875142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:07.875142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:07.875142 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:07.983469 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:40:08.014874 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:08.152496 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [{"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:08.308222 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attempting to attach volume ebaa470d-edc2-4620-ab84-c3d970a089f2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:40:08.309193 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:   <alias name="ua-ebaa470d-edc2-4620-ab84-c3d970a089f2"/>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:   <serial>ebaa470d-edc2-4620-ab84-c3d970a089f2</serial>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:08.309193 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:40:08.330497 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:08.333686 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzAVkeN8U7bIwitu7X+vC8w6QVojMw7Hmjcxq0rXUC5esnPDvt1R9j1YT6MZzhOjqqK8fZ8utHrFjDuzFxepKMS4Kjts4MxrrWr/TtvDtPavQDqzqyqyE2Mi+uBEsy1oA==',key_name='tempest-keypair-1288155932',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:16Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:40:04.442270',shelved_host='np0000000741',shelved_image_id='6309b710-810e-47a9-8417-e86dedd24a50'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:40:08.333686 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:08.333686 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:08.333686 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:40:08.334789 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.334789 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25254b82-6c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:08.335788 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.337140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:08.342318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.343255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.343255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e15ba9f-afd9-4a01-82ad-9cbe382b6f9c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:08.343719 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.344339 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:08.351221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.353410 np0000000741 nova-compute[97948]: INFO os_vif [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c')
May 14 03:40:08.353743 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Deleting instance files /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33_del
May 14 03:40:08.358201 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Deletion of /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33_del complete
May 14 03:40:08.376562 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:08.542694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:08.542992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:08.543599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:08.547974 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:08.547974 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Claim successful on node np0000000741
May 14 03:40:08.656064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:08.656064 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'flavor' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:08.767035 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:08.939828 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updated VIF entry in instance network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:40:08.940079 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap25254b82-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:08.947007 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0013852639999640814 future=<Future at 0x79d0b0785640 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.947270 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.947393 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.104485699999941 future=<Future at 0x79d0b0199a60 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.947529 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.104377791999923 future=<Future at 0x79d0b0199a60 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.947583 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.947823 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Emitting event <LifecycleEvent: 1778729993.9454958, a651c0b4-1267-4e3f-b151-7de64dd9e629 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:08.948270 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] VM Stopped (Lifecycle Event)
May 14 03:40:08.949076 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.560239587000069 future=<Future at 0x79d0b0188800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.949280 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.559987191000118 future=<Future at 0x79d0b0188800 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:08.951512 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Deleted allocations for instance a7a81f92-a39b-4a10-9868-39e256c3bc33
May 14 03:40:09.074990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.075539 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.075539 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:08:12:7d, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:09.075654 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Using config drive
May 14 03:40:09.195939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.203575 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.225974 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.342554 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.357664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.384755 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:09.384755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:09.385209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:09.385741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:09.385905 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:09.386036 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5e4ae774-3e65-48c0-bb92-a69a0a03b3ce req-afaee3e2-fce0-4517-b139-6b9cb6b3f79a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state rescued and task_state unrescuing.
May 14 03:40:09.441987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f3425eaa-16ca-494f-a047-f965740c539f req-23479eb6-95f2-43ee-b0b0-de1432bdd717 service nova] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:09.451392 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: a651c0b4-1267-4e3f-b151-7de64dd9e629] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:09.460372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:09.487296 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.502896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.521616 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999681261999967 future=<Future at 0x79d0907323f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:09.522939 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance destroyed successfully.
May 14 03:40:09.523324 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:09.580461 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:09.586544 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:09.726401 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Creating config drive at /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.config
May 14 03:40:09.731581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpun9zfc_9 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:09.794111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpun9zfc_9" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:09.967703 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.967859 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.967981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.968132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:09.968288 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] No VIF found with MAC fa:16:3e:54:94:99, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:10.026767 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<1c7ec2de-3093-4b9c-9b5b-58aad8cf125c> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:10.124989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:10.125653 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:10.389947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.415937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.549151 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.555011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.630669 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:10.790830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.912928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.939471 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:10.941779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:11.039663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:11.065168 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:11.068294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:11.141960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.599s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.142584 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:11.147424 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.687s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.519524 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:11.520689 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:11.521036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.521366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.522032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:11.522379 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state rescued and task_state unrescuing.
May 14 03:40:11.522568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:11.523308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:11.523709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.524001 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.524676 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Processing event network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:40:11.525246 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:11.525565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:11.525859 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.526019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.526194 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] No waiting events found dispatching network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:11.526547 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received unexpected event network-vif-plugged-d723f939-352b-42ab-adba-3e7b36e21bbe for instance with vm_state building and task_state spawning.
May 14 03:40:11.526547 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:11.526850 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:11.526949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.527084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.527936 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:11.528160 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state rescued and task_state unrescuing.
May 14 03:40:11.528326 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:11.528709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:11.528709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:11.528887 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.528887 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:11.529008 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dd3ca25c-cb70-46fb-bb31-91712a6b55f7 req-77326e14-fc33-44e6-aaf2-77ecad83bf6e service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received unexpected event network-vif-plugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with vm_state rescued and task_state unrescuing.
May 14 03:40:11.539058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dfd379d9-ee3e-4c4d-b0d1-dde5b569a680 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.597s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:11.653806 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:40:11.653806 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:40:11.653806 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:11.653806 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:11.765468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:11.765700 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:11.840591 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '518e7a04f399494ca70928d331e944f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8def9216ae6940d7b2f7dfc65003399e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:40:11.927229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:40:11.927887 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730011.927263, 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:11.928352 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] VM Started (Lifecycle Event)
May 14 03:40:11.936535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:40:11.940812 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance spawned successfully.
May 14 03:40:11.940812 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:40:12.067731 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0b664cfe-e8c3-47c1-89d1-4394233b6fb8 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:12.155777 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:40:12.245828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:12.246129 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:12.268815 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:12.433276 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:12.436853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:12.449204 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.449485 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.450064 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.451046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.451046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.452989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:12.643488 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Successfully created port: bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:40:12.659834 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:40:12.749502 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Detaching volume d6b6605e-28bc-486f-a8d3-77d2310a7a03
May 14 03:40:12.777329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.630s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:12.821765 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attempting to driver detach volume d6b6605e-28bc-486f-a8d3-77d2310a7a03 from mountpoint /dev/vdb
May 14 03:40:12.826997 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdb by alias ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:12.828186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdb by alias ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:12.828326 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Attempting to detach device vdb from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:40:12.828600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <alias name="ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03"/>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <serial>d6b6605e-28bc-486f-a8d3-77d2310a7a03</serial>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:12.828600 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:12.844785 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdb from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the persistent domain config.
May 14 03:40:12.844977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] (1/8): Attempting to detach device vdb with device alias ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03 from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:40:12.845311 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <alias name="ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03"/>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <serial>d6b6605e-28bc-486f-a8d3-77d2310a7a03</serial>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:12.845311 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:12.941235 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:40:12.941521 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730012.9413054, 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:12.941694 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] VM Paused (Lifecycle Event)
May 14 03:40:12.956621 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Took 8.73 seconds to spawn the instance on the hypervisor.
May 14 03:40:12.956942 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:13.095811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:13.265756 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Successfully updated port: bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:40:13.286495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1b7a0cb6-2113-476e-8e38-5a8053bd787a tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.134s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:13.287867 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.191s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:13.288820 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Unshelving
May 14 03:40:13.338672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-changed-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:13.338886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Refreshing instance network info cache due to event network-changed-bef13b3d-aead-48b8-93fb-3f92acbfe817. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:13.341159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] Acquiring lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:13.341159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] Acquired lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:13.341159 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Refreshing network info cache for port bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:13.344370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:13.349237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:13.349416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:13.446388 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:13.448911 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730013.4486148, 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:13.449095 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] VM Resumed (Lifecycle Event)
May 14 03:40:13.471102 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Took 14.43 seconds to build instance.
May 14 03:40:13.510084 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007682450000174867 future=<Future at 0x79d0b0188800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:13.510829 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:13.510829 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.010558503000084 future=<Future at 0x79d0907323f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:13.510829 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.01044294999997 future=<Future at 0x79d0907323f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:13.511038 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] Emitting event <LifecycleEvent: 1778729998.5091946, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:13.511247 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Stopped (Lifecycle Event)
May 14 03:40:13.544781 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:13.547935 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03 for instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:40:13.671795 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:40:13.672901 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:13.673205 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Creating image(s)
May 14 03:40:13.674574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:13.674971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:13.675618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:13.676271 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:13.680160 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:13.681507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:13.771331 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:13.797569 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:13.798231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:13.798750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:13.799418 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:13.806513 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:13.807040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:13.847915 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:13.855678 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:40:13.929509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.122s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:13.930316 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:13.955950 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:13.962316 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:13.972085 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:13.975171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.946s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:13.997783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk 1073741824" returned: 0 in 0.068s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:13.998239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:13.998593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:14.022519 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2334a42-5304-4fb8-8add-8f21da2ae976 tempest-ServerBootFromVolumeStableRescueTest-965770094 tempest-ServerBootFromVolumeStableRescueTest-965770094-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:14.109371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:14.111028 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:40:14.111347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:14.136027 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:14.203314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:14.203659 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Cannot resize image /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:40:14.203944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:40:14.204157 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Ensure instance console log exists: /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:14.204416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:14.204652 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:14.204828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:14.424225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:14.424774 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:14.428522 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:14.428712 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Claim successful on node np0000000741
May 14 03:40:14.469432 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c due to new event <LifecycleEvent: 1778730014.4688327, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:40:14.469636 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730014.4688327, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:14.469852 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Resumed (Lifecycle Event)
May 14 03:40:14.640694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaf5babc-0459-4cd3-ab08-86ef42069a8f req-496bf4c5-9fc6-4b61-9c03-8c79bd39d188 service nova] Releasing lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:14.640694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquired lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:14.640836 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:14.771815 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-changed-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:14.771993 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Refreshing instance network info cache due to event network-changed-d723f939-352b-42ab-adba-3e7b36e21bbe. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:14.772206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] Acquiring lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:14.772311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] Acquired lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:14.772980 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Refreshing network info cache for port d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:14.832963 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Booting with volume 699706de-e3f2-4c8c-9701-06264c0b0fe2 at /dev/vdc
May 14 03:40:14.899084 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:14.912525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:40:14.946656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:14.981090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:14.987392 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:15.000664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:40:15.000664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:40:15.010586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:40:15.012420 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe54:9499', 'fe80::fc94:2ff:fefc:dc2e', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:fe63:95d2', 'fe80::fc16:3eff:fe08:127d', 'fe80::fc16:3eff:feec:7d1a'] 
May 14 03:40:15.012583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:40:15.013851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:40:15.014297 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:15.017409 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating existing volume attachment record: 803da11d-2a58-4138-9231-5b0114d76bba {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:40:15.225965 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:15.274529 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:15.411565 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:15.490890 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730015.4904058, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:15.491425 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Started (Lifecycle Event)
May 14 03:40:15.608031 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Updating instance_info_cache with network_info: [{"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:15.701489 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:15.777943 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:15.778157 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:15.890749 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updated VIF entry in instance network info cache for port d723f939-352b-42ab-adba-3e7b36e21bbe. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:40:15.890749 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updating instance_info_cache with network_info: [{"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:15.995587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:15.996285 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:16.110077 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:16.110918 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Releasing lock "refresh_cache-e05e2694-be4d-4805-8364-f59ca03ed41c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:16.112795 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:16.113020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance network_info: |[{"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:40:16.116934 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Start _get_guest_xml network_info=[{"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:16.125175 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:16.126737 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-662859861', uuid='e05e2694-be4d-4805-8364-f59ca03ed41c'), owner=OwnerMeta(userid='518e7a04f399494ca70928d331e944f3', username='tempest-VolumesNegativeTest-2058048177-project-member', projectid='8def9216ae6940d7b2f7dfc65003399e', projectname='tempest-VolumesNegativeTest-2058048177'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730016.126309) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:16.132788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:16.135375 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:16.136694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:16.136898 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:16.138129 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:16.141720 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:16.143855 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:16.144151 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:16.144321 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:16.155326 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-662859861',display_name='tempest-VolumesNegativeTest-instance-662859861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesnegativetest-instance-662859861',id=34,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8def9216ae6940d7b2f7dfc65003399e',ramdisk_id='',reservation_id='r-l1jt0tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2058048177',owner_user_name='tempest-VolumesNegativeTest-2058048177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:13Z,user_data=None,user_id='518e7a04f399494ca70928d331e944f3',uuid=e05e2694-be4d-4805-8364-f59ca03ed41c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:16.155715 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converting VIF {"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:16.156344 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:16.157038 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lazy-loading 'pci_devices' on Instance uuid e05e2694-be4d-4805-8364-f59ca03ed41c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:16.392525 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ab5f580-59a2-4f17-8e08-955bff2507ba req-c4c05614-f62f-4094-8c0e-35f90f3cbb99 service nova] Releasing lock "refresh_cache-76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:16.499396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730016.4989493, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => ua-d6b6605e-28bc-486f-a8d3-77d2310a7a03> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:40:16.502604 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdb from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the live domain config.
May 14 03:40:16.503575 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:40:16.504015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:16.504245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:16.504679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:16.505046 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6b6605e-28bc-486f-a8d3-77d2310a7a03', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:40:16.505204 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:16.536792 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03 (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:16.537501 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '91')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:40:16.537501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', '89')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:16.539214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03', '88')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:16.539914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0037ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:40:16.539914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:40:16.542465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flush multipath device 330000000d55db966 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:40:16.573657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:16.614403 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:16.624654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:16.664454 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <uuid>e05e2694-be4d-4805-8364-f59ca03ed41c</uuid>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <name>instance-00000022</name>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesNegativeTest-instance-662859861</nova:name>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:16</nova:creationTime>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:user uuid="518e7a04f399494ca70928d331e944f3">tempest-VolumesNegativeTest-2058048177-project-member</nova:user>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:project uuid="8def9216ae6940d7b2f7dfc65003399e">tempest-VolumesNegativeTest-2058048177</nova:project>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         <nova:port uuid="bef13b3d-aead-48b8-93fb-3f92acbfe817">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="192.168.233.99" ipVersion="4"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="serial">e05e2694-be4d-4805-8364-f59ca03ed41c</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="uuid">e05e2694-be4d-4805-8364-f59ca03ed41c</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.config"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:e9:b0:32"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <target dev="tapbef13b3d-ae"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/console.log" append="off"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:16.664454 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Preparing to wait for external event network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-662859861',display_name='tempest-VolumesNegativeTest-instance-662859861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesnegativetest-instance-662859861',id=34,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8def9216ae6940d7b2f7dfc65003399e',ramdisk_id='',reservation_id='r-l1jt0tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2058048177',owner_user_name='tempest-VolumesNegativeTest-2058048177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:13Z,user_data=None,user_id='518e7a04f399494ca70928d331e944f3',uuid=e05e2694-be4d-4805-8364-f59ca03ed41c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converting VIF {"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:16.667888 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:16.669221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:16.669221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:16.670678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:16.671704 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf05ae04-6952-5b64-ba0b-fab4de9155d0', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:16.677457 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:16.682320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:16.682320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef13b3d-ae, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:16.682320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbef13b3d-ae, col_values=(('qos', UUID('0315a499-60ae-43b0-985d-2fa471edfdca')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:16.682320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbef13b3d-ae, col_values=(('external_ids', {'iface-id': 'bef13b3d-aead-48b8-93fb-3f92acbfe817', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:b0:32', 'vm-uuid': 'e05e2694-be4d-4805-8364-f59ca03ed41c'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:16.682777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:40:16.683038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:40:16.683375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:16.685044 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:16.687128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:40:16.691184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:16.691616 np0000000741 nova-compute[97948]: INFO os_vif [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae')
May 14 03:40:16.706143 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:40:16.707052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:40:16.718839 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.730472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:16.761344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.40.100,3260]
May 14 03:40:16.761344 np0000000741 nova-compute[97948]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.40.100,3260] successful.
May 14 03:40:16.761344 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.783786 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:16.796192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.812090 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.849111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.50.100,3260]
May 14 03:40:16.849111 np0000000741 nova-compute[97948]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-d6b6605e-28bc-486f-a8d3-77d2310a7a03, portal: 192.168.50.100,3260] successful.
May 14 03:40:16.849111 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.870289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:16.872374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:16.872374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== disconnect_volume: return (366ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:16.872374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:40:17.122383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.698s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:17.123145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.392s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:17.123407 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:17.127372 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_requests' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:17.289131 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:17.300733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:17.301053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:17.438593 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:17.632860 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:40:17.634802 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'numa_topology' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:17.638717 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:40:17.638717 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:17.638717 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:17.731515 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b24181722ce14df08872020f0eaece99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e302048ab6a04960bceff08f245070e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:40:17.808723 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:40:18.135563 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:40:18.139563 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:18.139763 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Claim successful on node np0000000741
May 14 03:40:18.211034 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:18.211165 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:18.211244 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] No VIF found with MAC fa:16:3e:e9:b0:32, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:18.211749 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Using config drive
May 14 03:40:18.289144 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:18.289314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 03:40:18.373926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:18.446653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a6955a44-87eb-4b82-b571-9374a0d5b388 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:18.548298 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:18.638795 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:40:18.721035 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:18.751581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:18.752025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:18.792355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] There are 0 instances to clean {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 03:40:18.792634 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:18.852678 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Successfully created port: 5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:40:18.888080 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Creating config drive at /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.config
May 14 03:40:18.891551 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5z3vdhqf {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:18.957676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5z3vdhqf" returned: 0 in 0.066s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:19.259011 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Detaching volume ebaa470d-edc2-4620-ab84-c3d970a089f2
May 14 03:40:19.287070 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:19.287585 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:19.312862 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Attempting to driver detach volume ebaa470d-edc2-4620-ab84-c3d970a089f2 from mountpoint /dev/vdc
May 14 03:40:19.326857 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdc by alias ua-ebaa470d-edc2-4620-ab84-c3d970a089f2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:19.335649 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Found disk vdc by alias ua-ebaa470d-edc2-4620-ab84-c3d970a089f2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:19.335649 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Attempting to detach device vdc from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:40:19.336134 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <alias name="ua-ebaa470d-edc2-4620-ab84-c3d970a089f2"/>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <serial>ebaa470d-edc2-4620-ab84-c3d970a089f2</serial>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:19.336134 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:19.346929 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdc from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the persistent domain config.
May 14 03:40:19.346929 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] (1/8): Attempting to detach device vdc with device alias ua-ebaa470d-edc2-4620-ab84-c3d970a089f2 from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:40:19.347306 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <alias name="ua-ebaa470d-edc2-4620-ab84-c3d970a089f2"/>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <serial>ebaa470d-edc2-4620-ab84-c3d970a089f2</serial>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:19.347306 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:19.411717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.471526 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.473724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.494035 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Successfully updated port: 5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:40:19.566921 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.569795 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-changed-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:19.570140 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Refreshing instance network info cache due to event network-changed-5b72916c-5ea1-4216-b96a-e3f0749869f8. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:19.570258 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] Acquiring lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:19.572111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] Acquired lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:19.572111 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Refreshing network info cache for port 5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:19.653980 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:40:19.656070 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:19.658579 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Creating image(s)
May 14 03:40:19.659494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:19.662009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:19.662009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:19.662009 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:19.670696 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:19.676675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:19.751261 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8e006dfa-d04a-4953-943d-94601ac65deb req-451775a2-9640-45a2-a005-54b59c115528 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:19.752857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8e006dfa-d04a-4953-943d-94601ac65deb req-451775a2-9640-45a2-a005-54b59c115528 service nova] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:19.753405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8e006dfa-d04a-4953-943d-94601ac65deb req-451775a2-9640-45a2-a005-54b59c115528 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:19.753603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8e006dfa-d04a-4953-943d-94601ac65deb req-451775a2-9640-45a2-a005-54b59c115528 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:19.753698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8e006dfa-d04a-4953-943d-94601ac65deb req-451775a2-9640-45a2-a005-54b59c115528 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Processing event network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:40:19.784372 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:19.785237 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:19.793695 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:19.813111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.137s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:19.813667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:19.814177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:19.815603 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:19.826198 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:19.827876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:19.828285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.848845 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:19.978631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.151s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:19.979108 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:19.998089 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730019.9957893, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => ua-ebaa470d-edc2-4620-ab84-c3d970a089f2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:40:19.999733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:20.000925 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-ebaa470d-edc2-4620-ab84-c3d970a089f2 for instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:40:20.009630 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully detached device vdc from instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 from the live domain config.
May 14 03:40:20.024870 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:40:20.031530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:20.031530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:20.031530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:20.031530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebaa470d-edc2-4620-ab84-c3d970a089f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:40:20.031530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:40:20.036029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:20.036411 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:20.060469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk 1073741824" returned: 0 in 0.081s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:20.060894 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:20.061507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:20.082367 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:20.090215 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2 (non-flash)
May 14 03:40:20.090556 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:20.090960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '91')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:40:20.091144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '90')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:20.097662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2', '91')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:20.097662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b02307c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'): ({'sdi'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:40:20.097853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:40:20.098308 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Flush multipath device 3300000001c8aa892 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:40:20.139564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:20.170989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:20.171898 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:40:20.173719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:20.195495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:20.205189 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:20.244464 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:40:20.244628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:40:20.245813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:40:20.266939 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:40:20.267191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:40:20.275449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Cannot resize image /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Ensure instance console log exists: /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:20.277436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:20.282842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.320475 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.40.100,3260]
May 14 03:40:20.320475 np0000000741 nova-compute[97948]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.40.100,3260] successful.
May 14 03:40:20.320475 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.345180 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.362435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.398652 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.50.100,3260]
May 14 03:40:20.398652 np0000000741 nova-compute[97948]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-ebaa470d-edc2-4620-ab84-c3d970a089f2, portal: 192.168.50.100,3260] successful.
May 14 03:40:20.398652 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.411379 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:20.416042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:20.416705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:20.416705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] <== disconnect_volume: return (390ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:20.416705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:40:20.496993 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:40:20.497265 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730020.4969687, e05e2694-be4d-4805-8364-f59ca03ed41c => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:20.497447 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] VM Started (Lifecycle Event)
May 14 03:40:20.502719 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:40:20.505125 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance spawned successfully.
May 14 03:40:20.505567 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:40:20.543258 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:20.914953 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2d528a5c-592e-41d2-aab8-13033dfa14a2 req-042f41ef-b9fc-4e19-9c37-cb75f6f49863 service nova] Releasing lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:20.915702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquired lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:20.916038 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:20.977388 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'flavor' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:21.001813 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:21.003917 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:21.016534 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.019660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.019660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.019660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.019660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.019660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:21.054191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.932s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:21.057292 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:21.060970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.687s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:21.069135 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:21.069135 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Claim successful on node np0000000741
May 14 03:40:21.145680 np0000000741 nova-compute[97948]: INFO nova.network.neutron [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating port 25254b82-6c2d-4326-b9f8-543a5c64160d with attributes {'binding:host_id': 'np0000000741', 'device_owner': 'compute:nova'}
May 14 03:40:21.506226 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:40:21.506564 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730021.5063298, e05e2694-be4d-4805-8364-f59ca03ed41c => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:21.506708 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] VM Paused (Lifecycle Event)
May 14 03:40:21.514363 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:21.524685 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Took 7.85 seconds to spawn the instance on the hypervisor.
May 14 03:40:21.524865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:21.686222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:21.713261 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:21.718720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:21.718798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:21.718997 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:21.783657 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:21.784231 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:21.804303 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:21.804303 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing instance network info cache due to event network-changed-25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:21.804303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] Acquiring lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] No waiting events found dispatching network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:21.844114 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-95d1f6d6-ee43-4ba7-b4cb-6c12cc484838 req-b6be4b80-12f1-4976-a1a1-c31d943c3502 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received unexpected event network-vif-plugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 for instance with vm_state active and task_state None.
May 14 03:40:21.917242 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating instance_info_cache with network_info: [{"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:21.985681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3c47522-60e6-42f6-9c4d-badc42353e2b tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.233s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:22.013735 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:22.020962 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730022.0206048, e05e2694-be4d-4805-8364-f59ca03ed41c => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:22.021184 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] VM Resumed (Lifecycle Event)
May 14 03:40:22.034597 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Took 13.54 seconds to build instance.
May 14 03:40:22.224994 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:22.327340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:22.327423 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:22.327696 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:22.328038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:22.328038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:22.341415 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Terminating instance
May 14 03:40:22.419411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Releasing lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:22.419719 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance network_info: |[{"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:40:22.422735 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Start _get_guest_xml network_info=[{"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:22.426001 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:22.428196 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-441132627', uuid='18681230-9203-4956-8193-a5cde97a52fa'), owner=OwnerMeta(userid='b24181722ce14df08872020f0eaece99', username='tempest-TestServerVolumeAttachmentScenario-742934758-project-member', projectid='e302048ab6a04960bceff08f245070e5', projectname='tempest-TestServerVolumeAttachmentScenario-742934758'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730022.4272926) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:22.432871 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:22.433607 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:22.438015 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:22.438665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:22.449568 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:22.450118 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:22.450356 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:22.450505 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:22.450694 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:22.450849 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:22.451002 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:22.451227 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:22.451385 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:22.451574 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:22.453740 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:22.458662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:22.478580 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-441132627',display_name='tempest-TestServerVolumeAttachmentScenario-server-441132627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachmentscenario-server-441132627',id=35,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPl9EOdV0X3mB4NSkwmLC9R4opIVZeRz5VJ6pqz6k1hQvt64cSCoQrqByRHI+jqJuNRLfqHk9J0QWpu6YMacVgdIbuaqH5ags9lBxkvJ248jbIDSa3zd/6Oltn5oAkJ/Q==',key_name='tempest-keypair-552183195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e302048ab6a04960bceff08f245070e5',ramdisk_id='',reservation_id='r-fo39m50q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-742934758',owner_user_name='tempest-TestServerVolumeAttachmentScenario-742934758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24181722ce14df08872020f0eaece99',uuid=18681230-9203-4956-8193-a5cde97a52fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:22.478967 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converting VIF {"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:22.479543 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:22.480161 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'pci_devices' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:22.523500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:22.526588 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:22.539755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-697e808f-896d-4083-b69b-46e9a446f448 tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.058s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:22.713290 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:22.783491 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:22.783631 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:22.783765 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:40:22.784027 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:22.795238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:22.795616 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:22.845201 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:40:22.876000 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.878852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.904466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.910138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.934706 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:22.941666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.987218 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <uuid>18681230-9203-4956-8193-a5cde97a52fa</uuid>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <name>instance-00000023</name>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-441132627</nova:name>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:22</nova:creationTime>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:user uuid="b24181722ce14df08872020f0eaece99">tempest-TestServerVolumeAttachmentScenario-742934758-project-member</nova:user>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:project uuid="e302048ab6a04960bceff08f245070e5">tempest-TestServerVolumeAttachmentScenario-742934758</nova:project>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         <nova:port uuid="5b72916c-5ea1-4216-b96a-e3f0749869f8">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="serial">18681230-9203-4956-8193-a5cde97a52fa</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="uuid">18681230-9203-4956-8193-a5cde97a52fa</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.config"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:02:0d:20"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <target dev="tap5b72916c-5e"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/console.log" append="off"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:22.987218 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Preparing to wait for external event network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-441132627',display_name='tempest-TestServerVolumeAttachmentScenario-server-441132627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachmentscenario-server-441132627',id=35,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPl9EOdV0X3mB4NSkwmLC9R4opIVZeRz5VJ6pqz6k1hQvt64cSCoQrqByRHI+jqJuNRLfqHk9J0QWpu6YMacVgdIbuaqH5ags9lBxkvJ248jbIDSa3zd/6Oltn5oAkJ/Q==',key_name='tempest-keypair-552183195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e302048ab6a04960bceff08f245070e5',ramdisk_id='',reservation_id='r-fo39m50q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-742934758',owner_user_name='tempest-TestServerVolumeAttachmentScenario-742934758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24181722ce14df08872020f0eaece99',uuid=18681230-9203-4956-8193-a5cde97a52fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:22.990476 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converting VIF {"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:22.994110 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:22.994110 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:22.994110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.994110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:22.994451 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:22.995159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.995318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b343d058-4c7b-55d6-afaf-97d253dcc558', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:22.996300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:22.997925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:23.004832 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.008394 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.008524 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b72916c-5e, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:23.011331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b72916c-5e, col_values=(('qos', UUID('51ea9d9c-8b24-42fc-a593-2a9b9f2e49aa')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:23.011331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b72916c-5e, col_values=(('external_ids', {'iface-id': '5b72916c-5ea1-4216-b96a-e3f0749869f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:0d:20', 'vm-uuid': '18681230-9203-4956-8193-a5cde97a52fa'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:23.012693 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.014077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:23.025528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.026527 np0000000741 nova-compute[97948]: INFO os_vif [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e')
May 14 03:40:23.094771 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:23.095075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.095213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.095349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:23.095473 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] No waiting events found dispatching network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:23.095612 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c65dda7-ac7e-4f1e-a5c5-110456d6d4b5 req-1cdf72b8-fe38-4b37-a822-a305aebd42d1 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:23.206906 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999716326999987 future=<Future at 0x79d090760b30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:23.209754 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Instance destroyed successfully.
May 14 03:40:23.210303 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lazy-loading 'resources' on Instance uuid 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:23.290287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.299094 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:23.370395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.370589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.370781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.370944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.371067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:23.374113 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Terminating instance
May 14 03:40:23.438233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:23.438694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:23.439184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] Acquired lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:23.439599 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Refreshing network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:23.441004 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating image(s)
May 14 03:40:23.441918 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.442310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.443149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:23.443468 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:23.552670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.714541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1395909558',display_name='tempest-AttachVolumeTestJSON-server-1395909558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumetestjson-server-1395909558',id=29,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2r8+TDLSzJhL/Oc1Ot8OmBDPOm3JCTgpTGlMa91L+BsuDL7N3EupTkeZJ//bukdpZjAQXo3DJhIx8061Se3TQNTSlcp6yPDsnNneJtNr6vvBP5HoRkZIbyxHePKIRcJg==',key_name='tempest-keypair-229393330',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:10Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3492928cd5f64475bf5572822120dbbc',ramdisk_id='',reservation_id='r-4ci61rp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1091031368',owner_user_name='tempest-AttachVolumeTestJSON-1091031368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03f07c927d2143d2961164592bd62449',uuid=430aef38-650f-4a88-a6c3-4f7ec9a5c6d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:40:23.714794 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converting VIF {"id": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "address": "fa:16:3e:54:94:99", "network": {"id": "65d7eba6-c1bc-42b6-9330-aaca5f2732b6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-669893956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3492928cd5f64475bf5572822120dbbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd99c42b-1c", "ovs_interfaceid": "dd99c42b-1c62-46bb-b5e0-ff23fd0953e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:23.715655 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:23.715655 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:40:23.716951 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.718628 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd99c42b-1c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:23.718628 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.719786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:23.724936 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.725586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.725792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=451be9c0-fa10-45df-aeb4-b60793e17aa4) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:23.727289 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.727816 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:23.732764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.735351 np0000000741 nova-compute[97948]: INFO os_vif [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:99,bridge_name='br-int',has_traffic_filtering=True,id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7,network=Network(65d7eba6-c1bc-42b6-9330-aaca5f2732b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd99c42b-1c')
May 14 03:40:23.735351 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Deleting instance files /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1_del
May 14 03:40:23.735351 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Deletion of /opt/stack/data/nova/instances/430aef38-650f-4a88-a6c3-4f7ec9a5c6d1_del complete
May 14 03:40:23.808981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.749s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:23.809585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.519s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.809881 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:23.811485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:23.811652 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:40:23.877758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:40:23.902865 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.926851 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:23.943963 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:23.945571 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:23.946508 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "159819827be12f7ad05a0a663daded742e4cc805" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:23.947970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "159819827be12f7ad05a0a663daded742e4cc805" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:23.958738 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:24.083876 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:24.085209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:24.085209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:24.085209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:24.085209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] No waiting events found dispatching network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:24.085209 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cbcec310-1c0b-468c-8b1f-34557ba697d5 req-761dd75f-c0e5-4e5f-8eca-75ae7a7c9789 service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999693795999974 future=<Future at 0x79d0907898b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Instance destroyed successfully.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lazy-loading 'resources' on Instance uuid e05e2694-be4d-4805-8364-f59ca03ed41c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bde0629c78549de8126765cd827cd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3eb60c511814747813d717f2e02a441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005386949999319768 future=<Future at 0x79d0907323f0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.684268908999911 future=<Future at 0x79d090760b30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.684142837000081 future=<Future at 0x79d090760b30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No VIF found with MAC fa:16:3e:02:0d:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Using config drive
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updated VIF entry in instance network info cache for port 25254b82-6c2d-4326-b9f8-543a5c64160d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:25.248797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-662859861',display_name='tempest-VolumesNegativeTest-instance-662859861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesnegativetest-instance-662859861',id=34,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:21Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8def9216ae6940d7b2f7dfc65003399e',ramdisk_id='',reservation_id='r-l1jt0tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2058048177',owner_user_name='tempest-VolumesNegativeTest-2058048177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:22Z,user_data=None,user_id='518e7a04f399494ca70928d331e944f3',uuid=e05e2694-be4d-4805-8364-f59ca03ed41c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converting VIF {"id": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "address": "fa:16:3e:e9:b0:32", "network": {"id": "9f4ef096-18a8-4118-b2d5-014fe4ab22e9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92799915210a494dadc223bfcfad6c66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef13b3d-ae", "ovs_interfaceid": "bef13b3d-aead-48b8-93fb-3f92acbfe817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef13b3d-ae, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0315a499-60ae-43b0-985d-2fa471edfdca) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: INFO os_vif [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:32,bridge_name='br-int',has_traffic_filtering=True,id=bef13b3d-aead-48b8-93fb-3f92acbfe817,network=Network(9f4ef096-18a8-4118-b2d5-014fe4ab22e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef13b3d-ae')
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Deleting instance files /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c_del
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Deletion of /opt/stack/data/nova/instances/e05e2694-be4d-4805-8364-f59ca03ed41c_del complete
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Successfully created port: 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4f2acf2b-3746-4b47-bbd6-155deca1e711 req-610445b5-e52d-4cdd-9c74-371b9398422b service nova] Releasing lock "refresh_cache-a7a81f92-a39b-4a10-9868-39e256c3bc33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] Acquiring lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] No waiting events found dispatching network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-unplugged-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Received event network-vif-deleted-dd99c42b-1c62-46bb-b5e0-ff23fd0953e7 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Neutron deleted interface dd99c42b-1c62-46bb-b5e0-ff23fd0953e7; detaching it from the instance and deleting it from the info cache
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:25.253500 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.255594 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.255594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.255594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.255594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.292914 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 03:40:25.293789 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:40:25.294120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:40:25.294249 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:40:25.294767 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.298047 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.part --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.298340 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] 6309b710-810e-47a9-8417-e86dedd24a50 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:40:25.299031 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:40:25.299467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.part /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.341894 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Creating config drive at /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.config
May 14 03:40:25.343008 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.344005 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:40:25.346686 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:40:25.352565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.371061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwyzbuwtj {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.432200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwyzbuwtj" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.446499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.450879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.460524 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:25.494174 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:25.541085 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.544864 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '430aef38-650f-4a88-a6c3-4f7ec9a5c6d1' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '430aef38-650f-4a88-a6c3-4f7ec9a5c6d1' (instance-0000001d)
May 14 03:40:25.548600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.566977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.part /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.converted" returned: 0 in 0.267s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.581659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.666118 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.666590 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.684072 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c965c7de-7747-47d7-9944-8a3e80b293f9 req-a1d56b6b-e86a-4b19-b656-41fbfb4ef1a4 service nova] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Detach interface failed, port_id=dd99c42b-1c62-46bb-b5e0-ff23fd0953e7, reason: Instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:40:25.688534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805.converted --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.689489 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "159819827be12f7ad05a0a663daded742e4cc805" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.742s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:25.690140 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.693342 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.694968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.785335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.786002 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:40:25.789663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.790137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "159819827be12f7ad05a0a663daded742e4cc805" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:25.790709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "159819827be12f7ad05a0a663daded742e4cc805" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:25.791270 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.799600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.801140 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:25.818711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.893043 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Successfully updated port: 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:40:25.899631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.900030 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.935476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:25.936865 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805,backing_fmt=raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:25.964685 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:25.965207 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing instance network info cache due to event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:25.965385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:25.965598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:25.965784 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:25.973212 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.988496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:25.991298 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Took 1.75 seconds to deallocate network for instance.
May 14 03:40:26.031982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.035263 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid 'e05e2694-be4d-4805-8364-f59ca03ed41c' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e05e2694-be4d-4805-8364-f59ca03ed41c' (instance-00000022)
May 14 03:40:26.035661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805,backing_fmt=raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk 1073741824" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.036034 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "159819827be12f7ad05a0a663daded742e4cc805" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:26.036321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.056886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.090370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:26.147484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/159819827be12f7ad05a0a663daded742e4cc805 --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.148452 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'migration_context' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] Acquiring lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] No waiting events found dispatching network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:26.156499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d0e9fee-09be-4fea-ba73-a730e85d992e req-46b15848-5480-4206-ae39-1de334c4515a service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-unplugged-bef13b3d-aead-48b8-93fb-3f92acbfe817 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:26.157227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.157681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.271480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.271480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.289970 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:26.364093 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:26.373626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:40:26.373626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:26.376992 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Creating image(s)
May 14 03:40:26.377704 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:26.377958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:26.378496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:26.379125 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:26.383070 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.383604 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:26.384252 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.401807 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:26.403161 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:26.405550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.478530 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:26.486177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.490348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.515384 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:26.516073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:26.533933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.130s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.534367 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:26.534744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:26.535209 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:26.538392 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:40:26.538908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.596767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.597974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.633433 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:26.648553 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.649360 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.689207 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:26.700054 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Rebasing disk image.
May 14 03:40:26.701237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.724031 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.732667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk 1073741824" returned: 0 in 0.081s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.736664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:26.736664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.772775 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:26.778213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.801655 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Took 1.51 seconds to deallocate network for instance.
May 14 03:40:26.826466 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.125s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.832666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 -F raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.856839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.078s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.862654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12175MB free_disk=73.14308547973633GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:40:26.862971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:26.864328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.128s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.866436 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:40:26.868722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:26.958332 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730026.9558039, 18681230-9203-4956-8193-a5cde97a52fa => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:26.958580 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] VM Started (Lifecycle Event)
May 14 03:40:26.994738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:26.995244 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Cannot resize image /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:40:26.995931 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:40:26.996000 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Ensure instance console log exists: /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:26.999630 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:27.001134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:27.001494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:27.001720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:27.231025 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3e915365-8afd-46fe-b3c0-709d3aa94220 req-7f0344ed-0e4c-466a-9244-13ed5f30f9eb service nova] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Received event network-vif-deleted-bef13b3d-aead-48b8-93fb-3f92acbfe817 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:27.318872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:27.465550 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:27.470264 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730027.4698808, 18681230-9203-4956-8193-a5cde97a52fa => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:27.470484 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] VM Paused (Lifecycle Event)
May 14 03:40:27.502566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-857a739c-97c4-449d-a8ab-8172de1d1600 req-d437c66d-8453-4688-a4ab-fa7e1b6c1b7e service nova] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:27.504621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:27.504850 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:27.506757 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:27.507763 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:27.794784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 -F raw /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk" returned: 0 in 0.965s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:27.795080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:40:27.795236 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Ensure instance console log exists: /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:27.795483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:27.797388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:27.797388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:27.798454 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start _get_guest_xml network_info=[{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='80bf5d7b17df2fea635790ff0531f15c',container_format='bare',created_at=2026-05-14T03:39:57Z,direct_url=<?>,disk_format='qcow2',id=6309b710-810e-47a9-8417-e86dedd24a50,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1674772814-shelved',owner='bce458cafea74d40af089b430f6b92ce',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T03:40:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'a7a81f92-a39b-4a10-9868-39e256c3bc33', 'attached_at': '', 'detached_at': '', 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'serial': '699706de-e3f2-4c8c-9701-06264c0b0fe2'}, 'boot_index': None, 'attachment_id': '803da11d-2a58-4138-9231-5b0114d76bba', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:27.801141 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:27.802427 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1674772814', uuid='a7a81f92-a39b-4a10-9868-39e256c3bc33'), owner=OwnerMeta(userid='755776b8b15e43bbac70f82cfea689e2', username='tempest-AttachVolumeShelveTestJSON-1886486107-project-member', projectid='bce458cafea74d40af089b430f6b92ce', projectname='tempest-AttachVolumeShelveTestJSON-1886486107'), image=ImageMeta(id='6309b710-810e-47a9-8417-e86dedd24a50', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730027.8017755) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:27.804526 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:27.804917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:27.806061 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:27.806224 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:27.807951 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:27.808242 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='80bf5d7b17df2fea635790ff0531f15c',container_format='bare',created_at=2026-05-14T03:39:57Z,direct_url=<?>,disk_format='qcow2',id=6309b710-810e-47a9-8417-e86dedd24a50,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1674772814-shelved',owner='bce458cafea74d40af089b430f6b92ce',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T03:40:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:27.808380 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:27.808481 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:27.808634 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:27.811914 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:27.812017 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:27.812159 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:27.812266 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:27.812383 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:27.812473 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:27.812653 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:27.812840 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:27.973469 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:27.975170 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:28.005536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:28.006701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:28.007022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:28.007418 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:28.008264 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Processing event network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:40:28.008425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:28.008977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:28.011611 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:28.013337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:40:28.013985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:28.014297 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:28.021487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] No waiting events found dispatching network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:28.021728 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-f7624173-d684-4e5a-9a5c-edc9f96cd917 req-3fbe5f0e-ab27-4800-a462-472134d9c498 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received unexpected event network-vif-plugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 for instance with vm_state building and task_state spawning.
May 14 03:40:28.022746 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:40:28.025060 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance spawned successfully.
May 14 03:40:28.025458 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:40:28.074387 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:28.234408 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:28.316402 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:28.332927 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:40:28.333312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:28.333397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:28.333627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:28.333949 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:40:28.350354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:28.351672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:28.352489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:28.352723 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:28.353195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:28.353417 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:28.366363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:28.366363 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:28.372058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:28.372058 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:28.386142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2] added
May 14 03:40:28.386142 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:28.386142 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:28.386142 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:28.386142 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:28.386142 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:28.386142 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:28.386556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:28.386556 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:28.386656 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:28.391023 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2] added
May 14 03:40:28.391023 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:28.391023 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:28.391023 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:28.391023 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:28.391023 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:28.391023 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:28.391293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:28.391344 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:28.391493 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:28.412591 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:28.477353 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:40:28.477651 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730028.477448, 18681230-9203-4956-8193-a5cde97a52fa => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:28.477763 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] VM Resumed (Lifecycle Event)
May 14 03:40:28.522883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.007s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:28.525194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.662s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:28.539065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.539559 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.540339 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.540840 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.541342 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.542778 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:28.569718 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:28.595937 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Deleted allocations for instance 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1
May 14 03:40:28.913810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:28.914066 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance network_info: |[{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:40:28.916113 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start _get_guest_xml network_info=[{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:28.922441 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:28.923791 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-662956973', uuid='eb70716b-7c1c-4efe-aec2-f2780ad6ebff'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730028.923331) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:28.924968 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:28.925450 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:28.927221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:28.927439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:28.928349 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:28.928699 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:28.928898 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:28.929024 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:28.929156 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:28.929302 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:28.929504 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:28.929585 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:28.929669 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:28.929774 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:28.929904 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:28.930031 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:28.947285 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-662956973',display_name='tempest-ServerRescueNegativeTestJSON-server-662956973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-662956973',id=36,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7S4Hb/1r7evPWnzpybLs/rQIHvlRkCmm0YMZ82RxabhV5HSa0Qay9MVzDwNTpQMzvBRb4viSkxF789Or+6y5CmCDfP6sK5y7rZMpxyAz7n/ybMC9T/sTzhjFhteSeoxw==',key_name='tempest-keypair-104550465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-55ih66j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bde0629c78549de8126765cd827cd82',uuid=eb70716b-7c1c-4efe-aec2-f2780ad6ebff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:28.947460 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:28.948047 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:28.948600 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:28.979969 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:28.984288 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:29.049120 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Took 9.39 seconds to spawn the instance on the hypervisor.
May 14 03:40:29.049120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:29.288018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:29.288168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:29.387357 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:29.392105 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:29.399961 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:29.399961 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:29.406992 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:29.406992 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.413760 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.420029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.428859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.428859 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.428859 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.428859 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.428859 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:29.429134 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.429134 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.429134 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.429134 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.429134 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:29.439106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.439106 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.439106 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.439106 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.439106 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:29.439337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.439337 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.439337 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.439337 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.439337 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:29.451566 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <uuid>eb70716b-7c1c-4efe-aec2-f2780ad6ebff</uuid>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <name>instance-00000024</name>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-662956973</nova:name>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:28</nova:creationTime>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         <nova:port uuid="81eb0073-bed0-4c79-86a8-bb56d5861294">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="serial">eb70716b-7c1c-4efe-aec2-f2780ad6ebff</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="uuid">eb70716b-7c1c-4efe-aec2-f2780ad6ebff</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3a:ff:89"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <target dev="tap81eb0073-be"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/console.log" append="off"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:29.451566 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Preparing to wait for external event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-662956973',display_name='tempest-ServerRescueNegativeTestJSON-server-662956973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-662956973',id=36,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7S4Hb/1r7evPWnzpybLs/rQIHvlRkCmm0YMZ82RxabhV5HSa0Qay9MVzDwNTpQMzvBRb4viSkxF789Or+6y5CmCDfP6sK5y7rZMpxyAz7n/ybMC9T/sTzhjFhteSeoxw==',key_name='tempest-keypair-104550465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-55ih66j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bde0629c78549de8126765cd827cd82',uuid=eb70716b-7c1c-4efe-aec2-f2780ad6ebff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.455102 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:29.456449 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:29.456449 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.456449 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dcc8695-4a54-5d1c-a696-2da70604f8a9', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:29.457214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.457924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:29.459935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.462917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.463131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81eb0073-be, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:29.463507 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81eb0073-be, col_values=(('qos', UUID('fbf00ed6-a927-433d-890f-5926139ddcd4')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:29.463905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81eb0073-be, col_values=(('external_ids', {'iface-id': '81eb0073-bed0-4c79-86a8-bb56d5861294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ff:89', 'vm-uuid': 'eb70716b-7c1c-4efe-aec2-f2780ad6ebff'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:29.464740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.468340 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:29.471431 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.50.100,3260]
May 14 03:40:29.471431 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.50.100,3260] successful.
May 14 03:40:29.471431 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.473456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:29.474810 np0000000741 nova-compute[97948]: INFO os_vif [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be')
May 14 03:40:29.484207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.484681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.40.100,3260]
May 14 03:40:29.484681 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.40.100,3260] successful.
May 14 03:40:29.484681 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.490290 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 18681230-9203-4956-8193-a5cde97a52fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:40:29.499361 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.506610 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.507262 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:29.507262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:29.508451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] HCTL ('11', '-', '-', 0) found on session 92 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:29.508608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.515925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:29.516186 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:29.516540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:29.516540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:29.517422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] HCTL ('12', '-', '-', 0) found on session 93 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:29.517511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:29.526578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching for a device in session 92 and hctl ['11', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:29.533059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching for a device in session 93 and hctl ['12', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:29.560261 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Took 15.19 seconds to build instance.
May 14 03:40:29.612285 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d2a0afdf-49df-42a9-b430-11871f7a16ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614219 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 98331717-bd7f-486b-ad83-228f6b5e44b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614344 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614429 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614512 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614619 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.614828 np0000000741 nova-compute[97948]: WARNING nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance e05e2694-be4d-4805-8364-f59ca03ed41c is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 14 03:40:29.614923 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a7a81f92-a39b-4a10-9868-39e256c3bc33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.615045 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 18681230-9203-4956-8193-a5cde97a52fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.615166 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:40:29.615398 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:40:29.615563 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:40:26 up 32 min,  2 users,  load average: 8.57, 7.05, 4.00\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_37a8404c7d33468cab5b1fb42b63d221': '2', 'io_workload': '2', 'num_proj_61f7491c96154009b61199ad430386d3': '2', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '3', 'num_proj_bce458cafea74d40af089b430f6b92ce': '1', 'num_proj_b3eb60c511814747813d717f2e02a441': '3', 'num_vm_rescued': '1', 'num_vm_building': '2', 'num_proj_e302048ab6a04960bceff08f245070e5': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:40:29.623504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8a0398b-7783-46e3-b225-321b111d93c2 tempest-AttachVolumeTestJSON-1091031368 tempest-AttachVolumeTestJSON-1091031368-project-member] Lock "430aef38-650f-4a88-a6c3-4f7ec9a5c6d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.295s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:29.790593 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Detaching volume 93a21d9f-3ce6-4706-8db7-b662eee126ea
May 14 03:40:29.851905 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Attempting to driver detach volume 93a21d9f-3ce6-4706-8db7-b662eee126ea from mountpoint /dev/vdb
May 14 03:40:29.855991 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found disk vdb by alias ua-93a21d9f-3ce6-4706-8db7-b662eee126ea {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:29.857278 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found disk vdb by alias ua-93a21d9f-3ce6-4706-8db7-b662eee126ea {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:29.857493 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Attempting to detach device vdb from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:40:29.857960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <alias name="ua-93a21d9f-3ce6-4706-8db7-b662eee126ea"/>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <serial>93a21d9f-3ce6-4706-8db7-b662eee126ea</serial>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:29.857960 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:29.866062 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully detached device vdb from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the persistent domain config.
May 14 03:40:29.866230 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] (1/8): Attempting to detach device vdb with device alias ua-93a21d9f-3ce6-4706-8db7-b662eee126ea from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:40:29.866577 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <alias name="ua-93a21d9f-3ce6-4706-8db7-b662eee126ea"/>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <serial>93a21d9f-3ce6-4706-8db7-b662eee126ea</serial>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:29.866577 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:30.062732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.713s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:30.289684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:30.289938 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:30.527251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching for a device in session 92 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:30.527779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:30.533297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching for a device in session 93 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:30.533526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:30.564009 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730030.5635688, 98331717-bd7f-486b-ad83-228f6b5e44b0 => ua-93a21d9f-3ce6-4706-8db7-b662eee126ea> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:40:30.564788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-93a21d9f-3ce6-4706-8db7-b662eee126ea for instance 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:40:30.567378 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully detached device vdb from instance 98331717-bd7f-486b-ad83-228f6b5e44b0 from the live domain config.
May 14 03:40:30.567548 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:40:30.567853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:30.568032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:30.789666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-changed-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:30.789888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Refreshing instance network info cache due to event network-changed-5b72916c-5ea1-4216-b96a-e3f0749869f8. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:30.790175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] Acquiring lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:30.790175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] Acquired lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:30.790175 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Refreshing network info cache for port 5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:30.792401 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:30.997578 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:30.997719 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:30.997803 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:3a:ff:89, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:30.998270 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Using config drive
May 14 03:40:31.292021 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:31.300381 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:40:31.300584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.776s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:31.300975 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.982s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:31.300975 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:31.301147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97948) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 03:40:31.302441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:31.352363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:40:31.380383 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Deleted allocations for instance e05e2694-be4d-4805-8364-f59ca03ed41c
May 14 03:40:31.505564 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:31.653774 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Creating config drive at /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config
May 14 03:40:31.659669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpccuc5s7c {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:31.680259 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:31.726495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpccuc5s7c" returned: 0 in 0.066s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:31.803823 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:31.811530 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updated VIF entry in instance network info cache for port 5b72916c-5ea1-4216-b96a-e3f0749869f8. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:40:31.812043 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating instance_info_cache with network_info: [{"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:32.179372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:32.208290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:32.314838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8c617c6f-490c-4f5e-8d6c-f61e91927ad2 req-da3f404e-a141-4b86-b7d8-32ac542b028d service nova] Releasing lock "refresh_cache-18681230-9203-4956-8193-a5cde97a52fa" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:32.322387 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:32.325811 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:32.328758 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:32.372536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Found WWN 3300000008b44eac2 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:40:32.372536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:32.372536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '3300000008b44eac2', 'path': '/dev/dm-2', 'multipath_id': '3300000008b44eac2'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:32.372536 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b44eac2', 'path': '/dev/dm-2', 'multipath_id': '3300000008b44eac2'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:40:32.373330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.805s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:32.374485 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93a21d9f-3ce6-4706-8db7-b662eee126ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:40:32.374696 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:40:32.396263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-47f26827-7526-4879-89eb-abf6b57ad91c tempest-VolumesNegativeTest-2058048177 tempest-VolumesNegativeTest-2058048177-project-member] Lock "e05e2694-be4d-4805-8364-f59ca03ed41c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.026s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:32.410772 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:32.411089 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:32.411269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '93')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:40:32.414342 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '84')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:32.416555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea', '85')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:40:32.418250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c1260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:40:32.418352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:40:32.418583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flush multipath device 3300000001d0409bf {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:40:32.442086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ae80a346-334a-4b54-ad84-a2cd5bba2e16 req-c31667d8-d932-4219-8d51-78a9225401fa service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:32.442086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae80a346-334a-4b54-ad84-a2cd5bba2e16 req-c31667d8-d932-4219-8d51-78a9225401fa service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:32.442086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae80a346-334a-4b54-ad84-a2cd5bba2e16 req-c31667d8-d932-4219-8d51-78a9225401fa service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:32.442086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ae80a346-334a-4b54-ad84-a2cd5bba2e16 req-c31667d8-d932-4219-8d51-78a9225401fa service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:32.442086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ae80a346-334a-4b54-ad84-a2cd5bba2e16 req-c31667d8-d932-4219-8d51-78a9225401fa service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Processing event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:40:32.457306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:32.505836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:40:32.561592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:40:32.561851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:40:32.563547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:40:32.578240 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:40:32.578412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:40:32.591411 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.629593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260]
May 14 03:40:32.629593 np0000000741 nova-compute[97948]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.40.100,3260] successful.
May 14 03:40:32.629593 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.644795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.659029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.692679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260]
May 14 03:40:32.692679 np0000000741 nova-compute[97948]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-93a21d9f-3ce6-4706-8db7-b662eee126ea, portal: 192.168.50.100,3260] successful.
May 14 03:40:32.692679 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.706944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:32.707198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:32.707368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== disconnect_volume: return (2139ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:32.707494 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:40:32.887662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6309b710-810e-47a9-8417-e86dedd24a50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1288155932',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:16Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:40:04.442270',shelved_host='np0000000741',shelved_image_id='6309b710-810e-47a9-8417-e86dedd24a50'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:32.887903 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:32.888614 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:32.889463 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_devices' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:33.114313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:40:33.115393 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730033.114813, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:33.115393 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Started (Lifecycle Event)
May 14 03:40:33.116998 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:40:33.118600 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance spawned successfully.
May 14 03:40:33.118977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:40:33.267658 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'flavor' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:33.394155 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:33.395566 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <uuid>a7a81f92-a39b-4a10-9868-39e256c3bc33</uuid>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <name>instance-0000001e</name>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1674772814</nova:name>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:27</nova:creationTime>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:user uuid="755776b8b15e43bbac70f82cfea689e2">tempest-AttachVolumeShelveTestJSON-1886486107-project-member</nova:user>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:project uuid="bce458cafea74d40af089b430f6b92ce">tempest-AttachVolumeShelveTestJSON-1886486107</nova:project>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         <nova:port uuid="25254b82-6c2d-4326-b9f8-543a5c64160d">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="serial">a7a81f92-a39b-4a10-9868-39e256c3bc33</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="uuid">a7a81f92-a39b-4a10-9868-39e256c3bc33</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <alias name="ua-699706de-e3f2-4c8c-9701-06264c0b0fe2"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-2"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <target dev="vdc" bus="virtio"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <serial>699706de-e3f2-4c8c-9701-06264c0b0fe2</serial>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:dd:c5:54"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <target dev="tap25254b82-6c"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/console.log" append="off"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:33.395566 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Preparing to wait for external event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6309b710-810e-47a9-8417-e86dedd24a50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1288155932',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:16Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:40:04.442270',shelved_host='np0000000741',shelved_image_id='6309b710-810e-47a9-8417-e86dedd24a50'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:33.398248 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:33.400011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.400011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:33.400011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:33.402401 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.402589 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e62ebe-307d-544b-a6c6-a3a19343a256', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:33.404558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.405283 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:33.407117 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.407197 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25254b82-6c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:33.407504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25254b82-6c, col_values=(('qos', UUID('84ed0db0-4aef-45b2-bfe7-b9c738b57142')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:33.407712 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25254b82-6c, col_values=(('external_ids', {'iface-id': '25254b82-6c2d-4326-b9f8-543a5c64160d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c5:54', 'vm-uuid': 'a7a81f92-a39b-4a10-9868-39e256c3bc33'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:33.408599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.409590 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:33.417823 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.419141 np0000000741 nova-compute[97948]: INFO os_vif [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c')
May 14 03:40:33.562850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:33.621367 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:33.630294 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:33.630889 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:33.635999 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:33.636856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:33.637240 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:33.637591 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:33.639504 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:40:34.146965 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:40:34.147360 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730034.1469862, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:34.147360 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Paused (Lifecycle Event)
May 14 03:40:34.150771 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Took 7.78 seconds to spawn the instance on the hypervisor.
May 14 03:40:34.151008 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:34.277625 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cd0a6050-aa86-4807-862c-9ea132139229 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.989s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:34.535502 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:34.536093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:34.536728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:34.536728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:34.536728 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:34.536728 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d8ed7008-1f69-49df-ab03-424419428095 req-015c3bcd-0be7-4a1c-8efe-d25adbcc13e2 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state active and task_state None.
May 14 03:40:34.652124 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:34.655916 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730034.6556313, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:34.656031 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Resumed (Lifecycle Event)
May 14 03:40:34.666821 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Took 16.35 seconds to build instance.
May 14 03:40:34.680955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:34.681262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:34.681471 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:34.681742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:34.681941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:34.684504 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Terminating instance
May 14 03:40:34.797497 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:40:34.797843 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.98 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:34.936976 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:34.937141 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:34.937288 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:34.939538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No VIF found with MAC fa:16:3e:dd:c5:54, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:34.939538 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Using config drive
May 14 03:40:35.160609 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:35.162318 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:35.169058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.868s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:35.189748 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:40:35.221551 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.222988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.248212 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.358886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.370500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.440940 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'ec2_ids' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:35.532370 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Instance destroyed successfully.
May 14 03:40:35.532837 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'resources' on Instance uuid 98331717-bd7f-486b-ad83-228f6b5e44b0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:35.541180 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:35.541372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:35.541540 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:35.541705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:35.541847 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:35.541999 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ffc6ef94-a89e-45db-a569-fc4b045fd44b req-d54ec437-f6fb-45df-99a3-04f2666da9d9 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:35.665122 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999696000000085 future=<Future at 0x79d0906e9ac0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:35.812342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:35.946364 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:35.946510 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'keypairs' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:36.035926 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1211408181',display_name='tempest-ServerActionsTestOtherA-server-42716224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-tempest-common-compute-instance-1211408181',id=27,image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOInQBSDR+K+02+ZS7/nFS6Tgk2VPclTa5BexiDW63dYcQSjrvm4ftTXRkKWLD70Oeue7t25z4OmvT3urDUcQYMgyrVhq7cGVAYlssaEsblCUNhFiQFa2UFxGhcCOKx+7Q==',key_name='tempest-keypair-813819026',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-8ay5vp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='90dea114-1289-407a-a228-c9bda70c7ed1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=98331717-bd7f-486b-ad83-228f6b5e44b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:40:36.036192 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "25eed01c-bba3-479b-af55-d34503546124", "address": "fa:16:3e:63:95:d2", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25eed01c-bb", "ovs_interfaceid": "25eed01c-bba3-479b-af55-d34503546124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:36.036551 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:36.036774 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:40:36.039500 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.039786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25eed01c-bb, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:36.041629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.042597 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:36.055085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.055085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.055085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4cc0824-e49c-4e56-a777-e7e6fb72c9d2) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:36.055085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.055085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:36.059368 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.062666 np0000000741 nova-compute[97948]: INFO os_vif [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:95:d2,bridge_name='br-int',has_traffic_filtering=True,id=25eed01c-bba3-479b-af55-d34503546124,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25eed01c-bb')
May 14 03:40:36.064111 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Deleting instance files /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0_del
May 14 03:40:36.065128 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Deletion of /opt/stack/data/nova/instances/98331717-bd7f-486b-ad83-228f6b5e44b0_del complete
May 14 03:40:36.220351 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:36.449071 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<a7a81f92-a39b-4a10-9868-39e256c3bc33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:40:36.454015 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:36.572019 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 03:40:36.572687 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:40:36.572883 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:40:36.572962 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:40:36.573174 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:36.595406 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Creating config drive at /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config
May 14 03:40:36.603171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp1u6z1je {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:36.630364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:36.632490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing instance network info cache due to event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:36.632888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:36.633078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:36.633138 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:36.646396 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:36.668397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp1u6z1je" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:40:37.135994 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:37.159099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c11ac19-9f5e-4548-ae41-33fdc9e13de2 req-8872d374-2fd9-4c89-afef-8a4fc5b5bff8 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-deleted-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:37.159218 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-1c11ac19-9f5e-4548-ae41-33fdc9e13de2 req-8872d374-2fd9-4c89-afef-8a4fc5b5bff8 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Neutron deleted interface 25eed01c-bba3-479b-af55-d34503546124; detaching it from the instance and deleting it from the info cache
May 14 03:40:37.159578 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1c11ac19-9f5e-4548-ae41-33fdc9e13de2 req-8872d374-2fd9-4c89-afef-8a4fc5b5bff8 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:37.175421 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.204499 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.209193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.305221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.560087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.564281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.571049 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.591544 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.593439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:37.603410 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:37.624894 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:37.625727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] Acquiring lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:37.625727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:37.625727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:37.625727 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] No waiting events found dispatching network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:37.627970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-129b1210-02c1-46f1-8617-2f55c38c3c6d req-a15adfe5-4077-4515-8cf3-d52aa759f6ac service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Received event network-vif-unplugged-25eed01c-bba3-479b-af55-d34503546124 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:37.666141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c11ac19-9f5e-4548-ae41-33fdc9e13de2 req-8872d374-2fd9-4c89-afef-8a4fc5b5bff8 service nova] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Detach interface failed, port_id=25eed01c-bba3-479b-af55-d34503546124, reason: Instance 98331717-bd7f-486b-ad83-228f6b5e44b0 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:40:37.680680 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:37.825312 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updated VIF entry in instance network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:40:37.825889 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:38.114194 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Took 1.54 seconds to deallocate network for instance.
May 14 03:40:38.173798 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730038.173381, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:38.173900 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Started (Lifecycle Event)
May 14 03:40:38.207005 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00047928100002536667 future=<Future at 0x79d090760b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:38.207616 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Emitting event <LifecycleEvent: 1778730023.2063875, 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:38.207903 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:38.208161 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] VM Stopped (Lifecycle Event)
May 14 03:40:38.209377 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.0244463589999668 future=<Future at 0x79d0907898b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:38.210705 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.0233860240000467 future=<Future at 0x79d0907898b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:38.328795 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-926f76ec-1196-44be-b5df-86730a918503 req-a068a136-3cd5-4d6b-a6ca-d6c8d8b0debb service nova] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:38.502234 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:40:38.566786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:38.620577 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:38.620790 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:38.681951 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:38.681951 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730038.6813073, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:38.681951 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Paused (Lifecycle Event)
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Processing event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:38.698431 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-300fc8e0-ecef-4726-9cfe-352c4fb1891d req-e4683a71-f0b5-4172-9932-be5e4a77f3a1 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received unexpected event network-vif-plugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with vm_state shelved_offloaded and task_state spawning.
May 14 03:40:38.700668 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:40:38.707064 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:40:38.712663 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance spawned successfully.
May 14 03:40:38.713442 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 430aef38-650f-4a88-a6c3-4f7ec9a5c6d1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:38.927006 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Refreshing inventories for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 03:40:39.010447 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Updating ProviderTree inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 03:40:39.010619 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:40:39.058289 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Refreshing aggregate associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, aggregates: None {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 03:40:39.129337 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Refreshing trait associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_MIPSEL,COMPUTE_NODE,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_AARCH64,COMPUTE_ARCH_RISCV64 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 03:40:39.184517 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:39.192781 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730039.1894863, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:39.192969 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Resumed (Lifecycle Event)
May 14 03:40:39.234175 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003484789999674831 future=<Future at 0x79d0907898b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:39.234352 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:39.234630 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.430361084000197 future=<Future at 0x79d0906e9ac0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:39.235613 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Emitting event <LifecycleEvent: 1778730024.2337058, e05e2694-be4d-4805-8364-f59ca03ed41c => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:39.235613 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.429345262000197 future=<Future at 0x79d0906e9ac0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:39.236077 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] VM Stopped (Lifecycle Event)
May 14 03:40:39.317532 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:39.682382 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:39.682763 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:39.695564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:39.700077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:40:39.740040 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f323774-307c-438f-a2d8-c017c1f690bc tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: e05e2694-be4d-4805-8364-f59ca03ed41c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:39.830026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-066587d0-77c3-4969-8282-4984102752b7 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.543s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:40.185144 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:40.691831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.071s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:40.756490 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Deleted allocations for instance 98331717-bd7f-486b-ad83-228f6b5e44b0
May 14 03:40:41.054274 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:41.766511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-03a72faa-e351-4875-b7f3-db1324ad3434 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "98331717-bd7f-486b-ad83-228f6b5e44b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.085s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:42.984778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:43.570341 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:44.870021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:45.250348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:45.250601 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:45.755545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:40:46.057533 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:46.309868 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:46.310119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:46.315046 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:46.315245 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Claim successful on node np0000000741
May 14 03:40:47.829161 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:47.829702 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:47.941233 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:48.331981 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:48.574489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:48.839604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:48.840179 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:49.349281 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:40:49.349618 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:40:49.349881 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:49.350094 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:49.440630 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71a50ef37e66489cbf8dc1dde0950769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a8404c7d33468cab5b1fb42b63d221', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:40:49.853581 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:40:50.090032 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Successfully created port: 075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:40:50.357773 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:40:50.665217 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004054779999478342 future=<Future at 0x79d0906e9ac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:50.665951 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Emitting event <LifecycleEvent: 1778730035.664688, 98331717-bd7f-486b-ad83-228f6b5e44b0 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:40:50.666137 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] VM Stopped (Lifecycle Event)
May 14 03:40:50.667304 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:50.864229 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Booting with volume e09e7940-a866-4f94-87b2-96b23f9ea816 at /dev/vda
May 14 03:40:50.921375 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:50.936185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:40:50.965094 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:40:51.023429 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:40:51.023847 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:40:51.043342 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:40:51.045948 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:fe08:127d', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48'] 
May 14 03:40:51.048883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:40:51.049024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:40:51.049390 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:51.049668 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating existing volume attachment record: 0f0bed02-241c-4c83-87fe-15430429b2a5 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:40:51.059440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:51.089138 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Successfully updated port: 075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:40:51.164631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-changed-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:51.166349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Refreshing instance network info cache due to event network-changed-075309ef-fec3-45a6-adad-f9090f09ef1c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:40:51.166349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:51.166349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:51.166349 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Refreshing network info cache for port 075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:40:51.169645 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 98331717-bd7f-486b-ad83-228f6b5e44b0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:40:51.263870 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:51.548752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:51.549201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:51.549454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:51.549626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:51.549809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:51.552720 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Terminating instance
May 14 03:40:51.594121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:40:51.667900 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:51.756304 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:51.930769 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:52.056483 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:40:52.078450 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.082486 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.110552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.232674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.238892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.251966 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:52.253326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:52.253487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:52.253620 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:52.253751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] No waiting events found dispatching network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:52.253873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70206cf7-c412-4864-8007-c96d5b1fe4d8 req-29cbf82d-5ffa-4b0f-81b4-3549861823c0 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:52.394260 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.9996432129999 future=<Future at 0x79d0b009de80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:52.394869 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999103577999904 future=<Future at 0x79d0b009de80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:52.395046 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998925328999803 future=<Future at 0x79d0b009de80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:40:52.396138 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Instance destroyed successfully.
May 14 03:40:52.396541 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'resources' on Instance uuid 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:52.432861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7ac3253-3670-40cc-9d81-054cc5044dfc req-b59a4e6a-fd35-4e86-bf91-dc2e80df7857 service nova] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:52.433322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:40:52.433522 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:40:52.898872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1271288932',display_name='tempest-AttachVolumeNegativeTest-server-1271288932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1271288932',id=33,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu1pSuZMV80gA0k0gv4S54IjootF5C+ysO3nTIFo0VuIhg2ZazzDEmxXJYpYL8Btfd1BEcG9qqvnbweO7foc4liadYYZ+TVRALqdWgulcB/zOAjp1UnwDOj2tW4Y6OkwQ==',key_name='tempest-keypair-169325770',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:12Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-pj9df8ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:40:52.899150 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "d723f939-352b-42ab-adba-3e7b36e21bbe", "address": "fa:16:3e:08:12:7d", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd723f939-35", "ovs_interfaceid": "d723f939-352b-42ab-adba-3e7b36e21bbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:52.899815 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:52.900094 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:40:52.901453 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.901776 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd723f939-35, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:52.902913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.903917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:52.904143 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.904910 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.905035 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=307f0c7c-25f7-44c8-9c5e-9e454cba6eb2) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:52.905484 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.906027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:52.906409 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:52.910249 np0000000741 nova-compute[97948]: INFO os_vif [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=d723f939-352b-42ab-adba-3e7b36e21bbe,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd723f939-35')
May 14 03:40:52.910556 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Deleting instance files /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9_del
May 14 03:40:52.911237 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Deletion of /opt/stack/data/nova/instances/76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9_del complete
May 14 03:40:53.011661 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:40:53.173777 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:40:53.173777 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:40:53.174224 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Creating image(s)
May 14 03:40:53.174691 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:40:53.175049 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:40:53.175350 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:53.175709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:53.175919 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:53.191170 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:53.350373 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:53.423884 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:40:53.425505 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:40:53.425991 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:40:53.426157 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:40:53.426459 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:53.509599 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:40:53.577222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:53.853263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:40:53.853506 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance network_info: |[{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:40:53.854557 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start _get_guest_xml network_info=[{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'serial': 'e09e7940-a866-4f94-87b2-96b23f9ea816'}, 'boot_index': 0, 'attachment_id': '0f0bed02-241c-4c83-87fe-15430429b2a5', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:40:53.857983 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:40:53.857983 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1795803912', uuid='3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7'), owner=OwnerMeta(userid='71a50ef37e66489cbf8dc1dde0950769', username='tempest-ServerActionsTestOtherA-882285516-project-member', projectid='37a8404c7d33468cab5b1fb42b63d221', projectname='tempest-ServerActionsTestOtherA-882285516'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730053.8574684) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:40:53.859903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:40:53.859903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:40:53.860689 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:40:53.861004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:40:53.862096 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:40:53.862663 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:40:53.863662 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:40:53.864000 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:40:53.864323 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:40:53.875035 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:40:53.875428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:40:53.875687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:53.876092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:53.876428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:40:53.896990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:53.897562 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:40:53.898161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:53.898825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:40:53.899341 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:53.899542 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:53.910749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:53.910749 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:53.917172 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:40:53.917172 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:53.924393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816] added
May 14 03:40:53.924393 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:53.924393 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:53.924393 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:53.924393 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:53.924393 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:53.924393 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:53.924672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:53.924909 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:53.925111 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:53.929686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816] added
May 14 03:40:53.929686 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:40:53.929686 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:53.929686 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:53.929686 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:40:53.929686 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:40:53.929686 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:53.929925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:40:53.930095 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:40:53.933661 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:40:53.987194 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dc646a26-5f90-4a82-8831-5078de52f9a7 req-6aa49ccb-c3e8-405a-977b-464304815fcc service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-deleted-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:53.987194 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-dc646a26-5f90-4a82-8831-5078de52f9a7 req-6aa49ccb-c3e8-405a-977b-464304815fcc service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Neutron deleted interface d723f939-352b-42ab-adba-3e7b36e21bbe; detaching it from the instance and deleting it from the info cache
May 14 03:40:53.987194 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dc646a26-5f90-4a82-8831-5078de52f9a7 req-6aa49ccb-c3e8-405a-977b-464304815fcc service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:54.325331 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:40:54.326697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] Acquiring lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:54.326697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:54.326697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:54.327349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] No waiting events found dispatching network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:40:54.327349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-666ace1a-9dac-43f6-a975-7a46470bcf5a req-f6f91e2f-dad7-44ad-96f8-60633a848b11 service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Received event network-vif-unplugged-d723f939-352b-42ab-adba-3e7b36e21bbe for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:40:54.417905 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:40:54.490555 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dc646a26-5f90-4a82-8831-5078de52f9a7 req-6aa49ccb-c3e8-405a-977b-464304815fcc service nova] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Detach interface failed, port_id=d723f939-352b-42ab-adba-3e7b36e21bbe, reason: Instance 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:40:54.510820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:54.510999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:54.919858 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Took 1.49 seconds to deallocate network for instance.
May 14 03:40:54.925422 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:40:54.931450 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:54.940584 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:54.940584 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:40:54.943100 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:40:54.943100 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:54.954781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:54.956564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:54.971371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.971371 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.971371 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.971371 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.971371 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:54.971601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.971601 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.971601 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.971601 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.971601 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:54.974609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.974609 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.974609 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.974609 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.974609 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:54.974787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.974787 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:54.974787 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.974787 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:54.974787 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:55.012775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:40:55.022299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260]
May 14 03:40:55.022299 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260] successful.
May 14 03:40:55.022299 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:55.025996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260]
May 14 03:40:55.025996 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260] successful.
May 14 03:40:55.025996 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:55.035041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:55.039825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.050917 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.051217 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:55.051371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:55.051471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:55.052473 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('8', '-', '-', 0) found on session 95 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:55.052597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.059174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:40:55.059436 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:40:55.059596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:55.059691 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:40:55.061191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('7', '-', '-', 0) found on session 94 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:40:55.061337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:40:55.067490 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 95 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:55.067625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:55.083201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 94 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:40:55.083201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:40:55.425210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:55.425583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:55.580767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:55.900621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:40:55.978954 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:55.979146 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:56.482870 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:56.921785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found WWN 330000000180e3ffd for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:40:56.922137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:40:56.922314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000180e3ffd', 'path': '/dev/dm-0', 'multipath_id': '330000000180e3ffd'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:40:56.923033 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000180e3ffd', 'path': '/dev/dm-0', 'multipath_id': '330000000180e3ffd'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:40:56.990071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.564s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:56.991231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.410s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:56.996774 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:40:56.996774 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Claim successful on node np0000000741
May 14 03:40:57.067499 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Deleted allocations for instance 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9
May 14 03:40:57.428311 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:40:57.428560 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:57.428952 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:57.429496 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:40:57.906309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.933221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] End _get_guest_xml xml=<domain type="qemu">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <uuid>3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</uuid>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <name>instance-00000025</name>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherA-server-1795803912</nova:name>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:40:53</nova:creationTime>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:user uuid="71a50ef37e66489cbf8dc1dde0950769">tempest-ServerActionsTestOtherA-882285516-project-member</nova:user>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:project uuid="37a8404c7d33468cab5b1fb42b63d221">tempest-ServerActionsTestOtherA-882285516</nova:project>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         <nova:port uuid="075309ef-fec3-45a6-adad-f9090f09ef1c">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <system>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="serial">3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="uuid">3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </system>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <os>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </os>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <features>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </features>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   <devices>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <alias name="ua-e09e7940-a866-4f94-87b2-96b23f9ea816"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <serial>e09e7940-a866-4f94-87b2-96b23f9ea816</serial>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </disk>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:92:8e:da"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <target dev="tap075309ef-fe"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </interface>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/console.log" append="off"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </serial>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <video>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </video>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </rng>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:   </devices>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]: </domain>
May 14 03:40:57.933221 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Preparing to wait for external event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:40:57.935390 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:40:57.935914 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:40:57.936209 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:40:57.936883 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.936883 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:57.937080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:40:57.939102 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.939287 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1941d75d-b2c8-5de8-8a34-38c1d4d65727', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:57.940196 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.941086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:57.941333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.943482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.943680 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap075309ef-fe, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:57.944071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap075309ef-fe, col_values=(('qos', UUID('d8444524-e873-4ec4-b37a-9c2b16458a46')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:57.945003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap075309ef-fe, col_values=(('external_ids', {'iface-id': '075309ef-fec3-45a6-adad-f9090f09ef1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8e:da', 'vm-uuid': '3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:40:57.946030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.947496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:40:57.952618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:57.953922 np0000000741 nova-compute[97948]: INFO os_vif [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe')
May 14 03:40:58.078142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dc7611d-b001-4f9a-ac43-f915dfe63983 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.529s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:58.514345 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:40:58.514438 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:40:58.579290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:40:59.017446 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:40:59.334812 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:40:59.335007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:40:59.474148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:59.474148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:40:59.474148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:92:8e:da, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:40:59.474148 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Using config drive
May 14 03:40:59.528046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.538s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:40:59.528330 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:40:59.837721 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Detaching volume 14d3512e-5443-48f9-9893-d251c448c92e
May 14 03:40:59.875705 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Attempting to driver detach volume 14d3512e-5443-48f9-9893-d251c448c92e from mountpoint /dev/vdb
May 14 03:40:59.878912 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-14d3512e-5443-48f9-9893-d251c448c92e {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:59.879914 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-14d3512e-5443-48f9-9893-d251c448c92e {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:40:59.880018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Attempting to detach device vdb from instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:40:59.880230 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <alias name="ua-14d3512e-5443-48f9-9893-d251c448c92e"/>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <serial>14d3512e-5443-48f9-9893-d251c448c92e</serial>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:59.880230 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:59.884453 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 from the persistent domain config.
May 14 03:40:59.884552 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] (1/8): Attempting to detach device vdb with device alias ua-14d3512e-5443-48f9-9893-d251c448c92e from instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:40:59.884889 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <alias name="ua-14d3512e-5443-48f9-9893-d251c448c92e"/>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <serial>14d3512e-5443-48f9-9893-d251c448c92e</serial>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]: </disk>
May 14 03:40:59.884889 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:40:59.979995 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:00.037738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:41:00.038316 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:41:00.038316 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:00.039111 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:00.129802 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Creating config drive at /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config
May 14 03:41:00.133239 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:41:00.139739 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxyicm9ve {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:00.205301 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxyicm9ve" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:00.541882 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:41:00.684096 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Successfully created port: c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:41:00.689379 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730060.6890135, 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 => ua-14d3512e-5443-48f9-9893-d251c448c92e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:41:00.694025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-14d3512e-5443-48f9-9893-d251c448c92e for instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:41:00.697239 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 from the live domain config.
May 14 03:41:00.699347 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:00.699810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:00.699986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:00.700869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:00.701162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14d3512e-5443-48f9-9893-d251c448c92e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:00.701320 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:00.732724 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:00.733038 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:00.733038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '95')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:00.733316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '86')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:00.734210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e', '87')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:00.736032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c1c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:00.736032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:00.736032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flush multipath device 330000000084a6c8d {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:00.767092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:00.801965 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.816455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:00.829411 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.832757 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.865113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:00.865234 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:00.867225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:00.881785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:00.882041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:00.895891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:00.934354 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.941798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.40.100,3260]
May 14 03:41:00.941798 np0000000741 nova-compute[97948]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.40.100,3260] successful.
May 14 03:41:00.941798 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:00.955344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.956411 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:00.964926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:00.977477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:01.010242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.50.100,3260]
May 14 03:41:01.010242 np0000000741 nova-compute[97948]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-14d3512e-5443-48f9-9893-d251c448c92e, portal: 192.168.50.100,3260] successful.
May 14 03:41:01.010242 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:01.029152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:01.029414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:01.029608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== disconnect_volume: return (329ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:01.029608 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:01.038216 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9bba9b36-aec6-4b28-a08b-4a56b687c64d req-21d244c6-1aa1-476a-a867-d782ada4f4c8 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:01.038591 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bba9b36-aec6-4b28-a08b-4a56b687c64d req-21d244c6-1aa1-476a-a867-d782ada4f4c8 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:01.038786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bba9b36-aec6-4b28-a08b-4a56b687c64d req-21d244c6-1aa1-476a-a867-d782ada4f4c8 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:01.039508 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9bba9b36-aec6-4b28-a08b-4a56b687c64d req-21d244c6-1aa1-476a-a867-d782ada4f4c8 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:01.040422 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9bba9b36-aec6-4b28-a08b-4a56b687c64d req-21d244c6-1aa1-476a-a867-d782ada4f4c8 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Processing event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:41:01.047473 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:41:01.284120 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Successfully updated port: c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:41:01.333856 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-changed-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:01.334035 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Refreshing instance network info cache due to event network-changed-c0ab1377-2999-44fb-b940-43667ecd7f3c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:01.334245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] Acquiring lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:01.334370 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] Acquired lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:01.334518 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Refreshing network info cache for port c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:01.551789 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Booting with volume 1d08a677-66dd-4256-86b0-6169bf67633c at /dev/vda
May 14 03:41:01.586923 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:01.588484 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:01.599214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:01.603046 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:41:01.603436 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730061.6031442, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:01.603616 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Started (Lifecycle Event)
May 14 03:41:01.606122 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:41:01.608393 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance spawned successfully.
May 14 03:41:01.608691 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:41:01.621172 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:01.658292 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:01.658533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:01.665209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:01.666427 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::fc16:3eff:fe5b:c8ff', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe92:8eda'] 
May 14 03:41:01.666534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:01.666632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:01.666861 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:01.667049 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Updating existing volume attachment record: 20bdc842-094d-41e1-9676-43120a09afd2 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:41:01.786297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:01.837324 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:01.907816 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:02.070418 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:02.106608 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:02.113971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:02.119302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.119490 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.119895 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.120193 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.120542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.120939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:02.573034 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-59259f34-294c-4efe-9ec9-f4ec983365c9 req-83cdb31c-75bc-4925-ab6c-7a32c0f2b585 service nova] Releasing lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:02.573664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:02.573820 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:02.596570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-07c184d5-28e2-4529-b4ff-3ab307d63ce7 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.261s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:02.619081 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:41:02.619081 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730062.6177628, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:02.619081 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Paused (Lifecycle Event)
May 14 03:41:02.627465 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Took 9.46 seconds to spawn the instance on the hypervisor.
May 14 03:41:02.627599 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:02.948311 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:03.112232 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:03.112605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:03.112605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:03.112686 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:03.112784 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:03.112918 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5ced54d9-e51d-4ffa-8163-7c15dd08c6ab req-ec9464c6-6412-46ce-83b5-75e043bb5a0f service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received unexpected event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with vm_state active and task_state None.
May 14 03:41:03.122963 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:03.125462 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730063.125224, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:03.125609 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Resumed (Lifecycle Event)
May 14 03:41:03.137804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Took 16.88 seconds to build instance.
May 14 03:41:03.163556 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:03.380055 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:03.545489 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Updating instance_info_cache with network_info: [{"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:03.581359 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:03.630761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:03.632263 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:03.643361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.393s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:03.695813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:03.695813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:03.695813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:03.695813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:03.695813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:03.697852 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Terminating instance
May 14 03:41:03.764185 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:41:03.765106 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:41:03.765362 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Creating image(s)
May 14 03:41:03.765629 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:41:03.765772 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Ensure instance console log exists: /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:41:03.765989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:03.766144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:03.766248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:04.047838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-aa344014-0ea0-498a-b2d4-eda732b0189d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:04.048245 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance network_info: |[{"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:41:04.049180 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Start _get_guest_xml network_info=[{"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'aa344014-0ea0-498a-b2d4-eda732b0189d', 'attached_at': '', 'detached_at': '', 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'serial': '1d08a677-66dd-4256-86b0-6169bf67633c'}, 'boot_index': 0, 'attachment_id': '20bdc842-094d-41e1-9676-43120a09afd2', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:04.051110 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:04.052564 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-279321093', uuid='aa344014-0ea0-498a-b2d4-eda732b0189d'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730064.0521567) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:04.054777 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:04.058933 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:04.060025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:04.060264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:04.061575 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:04.061972 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:04.062211 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:04.062351 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:04.062577 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:04.063553 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:04.063749 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:04.064018 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:04.064206 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:04.064406 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:04.064554 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:04.064789 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:04.086499 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:04.089574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:04.089791 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:04.090267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:04.090488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:04.102455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:04.103203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:04.103815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:04.104112 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:04.104541 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:04.104808 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:04.119042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:04.119042 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:04.126437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:04.126437 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:04.135978 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c] added
May 14 03:41:04.135978 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:04.135978 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:04.135978 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:04.135978 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:04.135978 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:04.135978 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:04.136286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:04.136369 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:04.136551 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:04.138826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c] added
May 14 03:41:04.138826 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:04.138826 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:04.138826 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:04.138826 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:04.138826 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:04.138826 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:04.139021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:04.139206 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:04.139358 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:04.200991 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:41:04.225313 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:04.253583 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:04.272159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:04.281896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:04.429472 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:04.429841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:04.429841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:04.430071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:04.430150 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] No waiting events found dispatching network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:04.430239 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b8253c93-edbf-4549-86a7-a54553622783 req-8b73c923-9dd6-4acd-86fb-ce0fab969292 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:04.572275 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999568855000007 future=<Future at 0x79d0b0775070 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:04.574120 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Instance destroyed successfully.
May 14 03:41:04.574732 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'resources' on Instance uuid 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:05.078347 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-639199850',display_name='tempest-AttachVolumeNegativeTest-server-639199850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-639199850',id=28,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGizj4EwMTGZVY+qCm2Zq6iSfwfbSFiQBvyXcmzcLI8UQvSfsbOt95/+ox8EP09kM8PrbCFCJvctxmmr/hN1pTdAItwyGhdxOghGBbcVOVszVFr5vLVbsFnzqWCDZw/ZpA==',key_name='tempest-keypair-484503271',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:05Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-2p2uy7bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:41:05.081914 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "address": "fa:16:3e:5b:c8:ff", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd6eaf27-8a", "ovs_interfaceid": "bd6eaf27-8ad9-4231-bbca-c7335df3a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:05.081914 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:05.081914 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:41:05.082403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.082403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd6eaf27-8a, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:05.083323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.084089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:05.084560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.085341 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.085482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3eb8ee3-151d-4a94-bcaa-a957c8996a0c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:05.085935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.086413 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:05.088214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:05.092803 np0000000741 nova-compute[97948]: INFO os_vif [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:c8:ff,bridge_name='br-int',has_traffic_filtering=True,id=bd6eaf27-8ad9-4231-bbca-c7335df3a838,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd6eaf27-8a')
May 14 03:41:05.092803 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Deleting instance files /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9_del
May 14 03:41:05.093609 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Deletion of /opt/stack/data/nova/instances/8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9_del complete
May 14 03:41:05.137172 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:05.139877 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:05.153560 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:05.153560 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:05.158684 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:05.158684 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.177256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.181657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.202207 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:05.203539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.203539 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.203539 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.203539 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.203539 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.204467 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:05.207092 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing instance network info cache due to event network-changed-d42b1eb4-3b46-484f-8eb9-976dce88b189. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:05.207092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Acquiring lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:05.207092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Acquired lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:05.207092 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Refreshing network info cache for port d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:05.241277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.50.100,3260]
May 14 03:41:05.241277 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.50.100,3260] successful.
May 14 03:41:05.241277 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.248218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.40.100,3260]
May 14 03:41:05.248218 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.40.100,3260] successful.
May 14 03:41:05.248218 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.256153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.261169 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.275347 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.275796 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:05.276239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:05.276414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.277037 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:05.277947 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:05.278276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:05.278419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:05.279380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('10', '-', '-', 0) found on session 97 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:05.279380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:05.281050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('9', '-', '-', 0) found on session 96 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:05.281050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:05.314353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 97 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:05.314353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:05.314353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 96 and hctl ['9', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:05.314353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:05.603965 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 03:41:05.606837 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:41:05.607019 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:41:05.610669 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:41:05.610669 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:05.671727 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:05.709334 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:06.106111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:41:06.175091 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:06.335353 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updated VIF entry in instance network info cache for port d42b1eb4-3b46-484f-8eb9-976dce88b189. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:06.335922 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [{"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:06.498891 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:06.499437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] Acquiring lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:06.499676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:06.500348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:06.500348 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] No waiting events found dispatching network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:06.500348 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a352449f-c6fb-4ab8-b88d-fc0d6c419978 req-7a5ed149-65cb-49cf-80c0-edee9085b509 service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-unplugged-bd6eaf27-8ad9-4231-bbca-c7335df3a838 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:06.634040 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:06.838176 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Releasing lock "refresh_cache-d2a0afdf-49df-42a9-b430-11871f7a16ef" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:06.838414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-changed-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:06.838414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Refreshing instance network info cache due to event network-changed-075309ef-fec3-45a6-adad-f9090f09ef1c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:06.838556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:06.838629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:06.838771 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Refreshing network info cache for port 075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:07.125770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 3300000001d388906 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:07.126026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:07.128633 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000001d388906', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000001d388906'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:07.128836 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001d388906', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000001d388906'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:07.136183 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Took 1.53 seconds to deallocate network for instance.
May 14 03:41:07.184145 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'aa344014-0ea0-498a-b2d4-eda732b0189d', 'attached_at': '', 'detached_at': '', 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'serial': '1d08a677-66dd-4256-86b0-6169bf67633c'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:41:07.184878 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:41:07.185111 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:07.188017 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:07.212306 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.luks [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 03:41:07.213564 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:41:07.213564 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:07.213564 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:07.213803 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x79d0b009cda0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'aa344014-0ea0-498a-b2d4-eda732b0189d', 'attached_at': '', 'detached_at': '', 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'serial': '1d08a677-66dd-4256-86b0-6169bf67633c'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:41:07.213971 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] formatting encrypted volume /dev/dm-1 {{(pid=97948) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 03:41:07.282585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:07.283245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:07.303200 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a5f8195c-c4c9-4171-ae2a-d8717615002a req-0b9df0e2-8998-485c-b634-de7baeeb66ff service nova] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Received event network-vif-deleted-bd6eaf27-8ad9-4231-bbca-c7335df3a838 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:07.343907 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:07.394437 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005418410000856966 future=<Future at 0x79d0b009de80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:07.394779 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:07.395209 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778730052.3937643, 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:07.395419 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.176382715999807 future=<Future at 0x79d0b0775070 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:07.395561 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.176244910999912 future=<Future at 0x79d0b0775070 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:07.396093 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] VM Stopped (Lifecycle Event)
May 14 03:41:07.546379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Stashing vm_state: active {{(pid=97948) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 03:41:07.650699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:07.651297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:07.768490 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:07.788620 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:07.898704 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: 76a85d9c-3696-4d8d-8296-c7fe5f6e3cf9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:07.970325 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updated VIF entry in instance network info cache for port 075309ef-fec3-45a6-adad-f9090f09ef1c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:07.971004 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:08.126818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:08.345724 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:08.346838 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:08.473046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f9920c6e-1c10-4251-a256-ca90236a62bd req-e2690639-99cf-43e9-a170-a919d0018078 service nova] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:08.583820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:08.793366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:08.849691 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:09.358264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.707s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:09.360462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.233s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:09.451813 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Deleted allocations for instance 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9
May 14 03:41:09.866173 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:41:09.866314 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Claim successful on node np0000000741
May 14 03:41:09.890810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:09.891058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:09.891346 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attaching volume a575292f-fbda-488f-884c-dba6e6653b52 to /dev/vdb
May 14 03:41:09.944589 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:09.961319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:09.994381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:10.050845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:10.051187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:10.060581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:10.062875 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe92:8eda'] 
May 14 03:41:10.063109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:10.064210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:10.064210 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:10.064210 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating existing volume attachment record: f96372ba-b65c-4922-b469-2844eb0ccca7 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:41:10.087346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:10.372467 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating resource usage from migration dbed985f-5058-428e-9c18-890a53db0040
May 14 03:41:10.465883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37acb9ea-cb1d-4f10-b681-493406f50d42 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.771s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:10.617647 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:10.617961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:10.618263 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:10.618774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:10.619702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:10.635303 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:10.635932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:10.636397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:10.636685 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:10.637221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:10.637623 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:10.653536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:10.653536 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:10.665371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:10.665371 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:10.671102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52] added
May 14 03:41:10.671102 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:10.671102 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:10.671102 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:10.671102 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:10.671102 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:10.671102 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:10.671415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:10.672159 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:10.672459 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:10.676392 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52] added
May 14 03:41:10.676392 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:10.676392 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:10.676392 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:10.676392 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:10.676392 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:10.676392 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:10.676796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:10.676865 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:10.677048 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:10.954093 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:10.954323 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:11.457114 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:11.664054 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:41:11.664054 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:41:11.664054 np0000000741 nova-compute[97948]:     <volume>1d08a677-66dd-4256-86b0-6169bf67633c</volume>
May 14 03:41:11.664054 np0000000741 nova-compute[97948]:   </usage>
May 14 03:41:11.664054 np0000000741 nova-compute[97948]: </secret>
May 14 03:41:11.664054 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:41:11.673209 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:11.677927 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:11.692121 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:11.692121 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:11.703685 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:11.703685 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.713568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.723033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.731723 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.732684 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.744592 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.744827 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:11.782414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.50.100,3260]
May 14 03:41:11.782414 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.50.100,3260] successful.
May 14 03:41:11.782414 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.790850 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.40.100,3260]
May 14 03:41:11.790850 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.40.100,3260] successful.
May 14 03:41:11.790850 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.797396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.805826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825012 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825505 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.825792 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:11.826113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:11.826196 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:11.827006 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:11.827006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:11.828401 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] HCTL ('13', '-', '-', 0) found on session 98 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:11.828549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:11.829462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] HCTL ('14', '-', '-', 0) found on session 99 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:11.829511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:11.851598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching for a device in session 98 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:11.853603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:11.855769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching for a device in session 99 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:11.855769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:11.922884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:11.923162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:11.966122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.607s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:11.966122 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Migrating
May 14 03:41:11.966301 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:41:12.175570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279321093',display_name='tempest-TestVolumeBootPattern-server-279321093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-279321093',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-n5i064ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:01Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=aa344014-0ea0-498a-b2d4-eda732b0189d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:12.175903 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:12.176695 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:12.177996 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid aa344014-0ea0-498a-b2d4-eda732b0189d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:12.427684 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'flavor' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:12.487604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:12.488179 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:12.488179 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:12.636912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:41:12.681272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <uuid>aa344014-0ea0-498a-b2d4-eda732b0189d</uuid>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <name>instance-00000026</name>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-279321093</nova:name>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:04</nova:creationTime>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <nova:port uuid="c0ab1377-2999-44fb-b940-43667ecd7f3c">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="serial">aa344014-0ea0-498a-b2d4-eda732b0189d</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="uuid">aa344014-0ea0-498a-b2d4-eda732b0189d</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/disk.config"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <alias name="ua-1d08a677-66dd-4256-86b0-6169bf67633c"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <serial>1d08a677-66dd-4256-86b0-6169bf67633c</serial>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <encryption format="luks">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:         <secret type="passphrase" uuid="9407fbbe-c8f5-4ed3-a64e-49db7314212c"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       </encryption>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:6a:76:bf"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <target dev="tapc0ab1377-29"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/console.log" append="off"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:12.681272 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Preparing to wait for external event network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279321093',display_name='tempest-TestVolumeBootPattern-server-279321093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-279321093',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-n5i064ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:01Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=aa344014-0ea0-498a-b2d4-eda732b0189d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:12.684734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:41:12.685447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.685602 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f674c2e-0ffc-5601-a8a4-df61da883fd3', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:12.686372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.687194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:12.688786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.691037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.691369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ab1377-29, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:12.691814 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0ab1377-29, col_values=(('qos', UUID('f93968d3-f399-4ae0-8882-6b865468a180')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:12.692051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0ab1377-29, col_values=(('external_ids', {'iface-id': 'c0ab1377-2999-44fb-b940-43667ecd7f3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:76:bf', 'vm-uuid': 'aa344014-0ea0-498a-b2d4-eda732b0189d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:12.694350 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.695898 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:12.700676 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:12.701688 np0000000741 nova-compute[97948]: INFO os_vif [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29')
May 14 03:41:12.990569 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:13.361479 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:13.433379 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:13.500106 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:13.586110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:13.621545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:13.621756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:13.651948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found WWN 3300000003af2d66b for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:13.652195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:13.652335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000003af2d66b', 'path': '/dev/dm-5', 'multipath_id': '3300000003af2d66b'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:13.652439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003af2d66b', 'path': '/dev/dm-5', 'multipath_id': '3300000003af2d66b'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:13.654420 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:14.001882 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:14.123785 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:41:14.157365 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attempting to attach volume a575292f-fbda-488f-884c-dba6e6653b52 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:41:14.159140 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:   <alias name="ua-a575292f-fbda-488f-884c-dba6e6653b52"/>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:   <serial>a575292f-fbda-488f-884c-dba6e6653b52</serial>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:14.159140 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:41:14.220535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:14.220726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:14.220859 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:6a:76:bf, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:14.221512 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Using config drive
May 14 03:41:14.504237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:14.504237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:14.505009 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attaching volume 37550fb5-203a-4ec4-873a-c12ccbe53e60 to /dev/vdb
May 14 03:41:14.572393 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:14.587272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:14.614586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:14.666458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:14.666752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:14.676892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:14.678416 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe92:8eda'] 
May 14 03:41:14.678556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:14.678705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:14.679025 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:14.679302 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating existing volume attachment record: b1af9955-56f4-4b7d-8d7b-a30eda379536 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:41:14.683744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:14.684118 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:14.688210 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:41:14.688350 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Claim successful on node np0000000741
May 14 03:41:14.729178 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:14.869937 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Creating config drive at /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/disk.config
May 14 03:41:14.872754 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcwqqj3t9 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:14.929767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcwqqj3t9" returned: 0 in 0.057s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:15.244449 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:15.244988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:15.245197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:15.246164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:15.246164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:15.258242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:15.258867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:15.261060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:15.261060 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:15.261060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:15.261255 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:15.275937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:15.275937 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:15.281674 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:15.281674 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:15.295395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60] added
May 14 03:41:15.295395 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:15.295395 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:15.295395 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:15.295395 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:15.295395 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:15.295395 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:15.295720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:15.295746 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:15.295931 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60] added
May 14 03:41:15.301776 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:15.301776 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:15.301776 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:15.403295 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.432202 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.523694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Starting migrate_disk_and_power_off {{(pid=97948) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 03:41:15.527457 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.548122 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.567072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.605599 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cca2b34-441a-4cf6-9a4f-ca470e507bd4 req-3320aa73-7192-44a1-8f7b-29bcffa4efa6 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:15.606008 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cca2b34-441a-4cf6-9a4f-ca470e507bd4 req-3320aa73-7192-44a1-8f7b-29bcffa4efa6 service nova] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:15.606144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cca2b34-441a-4cf6-9a4f-ca470e507bd4 req-3320aa73-7192-44a1-8f7b-29bcffa4efa6 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:15.606261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cca2b34-441a-4cf6-9a4f-ca470e507bd4 req-3320aa73-7192-44a1-8f7b-29bcffa4efa6 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:15.606389 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cca2b34-441a-4cf6-9a4f-ca470e507bd4 req-3320aa73-7192-44a1-8f7b-29bcffa4efa6 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Processing event network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:41:15.704424 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.713893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.715009 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.744809 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.755809 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.825162 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:15.825340 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:15.825876 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:15.826018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No VIF found with MAC fa:16:3e:02:0d:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:15.865185 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999586106999914 future=<Future at 0x79d0b81e5eb0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:15.881666 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance destroyed successfully.
May 14 03:41:15.881666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:41:15.881666 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:15.881666 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:15.881666 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:41:15.882617 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.883539 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap075309ef-fe, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:15.884732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.885885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:15.887010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.889272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.889272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8444524-e873-4ec4-b37a-9c2b16458a46) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:15.890328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.890328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:15.891121 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:15.894193 np0000000741 nova-compute[97948]: INFO os_vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe')
May 14 03:41:15.897037 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:15.897313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:15.900479 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:16.010806 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:16.212788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:16.213438 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:16.296391 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:16.300467 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:16.308181 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:16.308181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:16.315820 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:16.315820 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.320867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.325957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.341248 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.349125 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsi session list stdout=tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.349743 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:16.387997 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.50.100,3260]
May 14 03:41:16.387997 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.50.100,3260] successful.
May 14 03:41:16.387997 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.394508 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.40.100,3260]
May 14 03:41:16.394508 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.40.100,3260] successful.
May 14 03:41:16.394508 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.401027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.407425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.425792 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.426026 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:16.426237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:16.426280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:16.427621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] HCTL ('15', '-', '-', 0) found on session 100 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:16.427785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.432318 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:16.432623 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:16.432823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:16.432823 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:16.433741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] HCTL ('16', '-', '-', 0) found on session 101 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:16.433840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:16.446856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching for a device in session 100 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:16.447706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:16.461751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching for a device in session 101 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:16.461751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:16.715804 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:17.067618 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730077.067261, aa344014-0ea0-498a-b2d4-eda732b0189d => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:17.067994 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] VM Started (Lifecycle Event)
May 14 03:41:17.069002 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:41:17.071307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:41:17.073311 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance spawned successfully.
May 14 03:41:17.073570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:41:17.225665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.539s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:17.225665 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:41:17.227764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:17.227965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:17.260881 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:41:17.376014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4ec0202a-fb85-4b7d-96bc-3ecc694ba7bb tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.485s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:17.570324 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:17.571777 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:17.580002 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.580123 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.580533 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.580760 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.581004 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.581320 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] No waiting events found dispatching network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received unexpected event network-vif-plugged-c0ab1377-2999-44fb-b940-43667ecd7f3c for instance with vm_state building and task_state spawning.
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received unexpected event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with vm_state active and task_state resize_migrating.
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:17.687738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:17.688619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:17.689036 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:17.689036 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-56dbc0b2-4898-4172-8e9c-d3d235685a70 req-b624a777-1ef0-486b-870a-ba1ae2b74760 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received unexpected event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with vm_state active and task_state resize_migrating.
May 14 03:41:17.732427 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:41:17.732877 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:41:17.733108 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:17.733362 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:17.735713 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Detaching volume 699706de-e3f2-4c8c-9701-06264c0b0fe2
May 14 03:41:17.789559 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Attempting to driver detach volume 699706de-e3f2-4c8c-9701-06264c0b0fe2 from mountpoint /dev/vdc
May 14 03:41:17.794943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Found disk vdc by alias ua-699706de-e3f2-4c8c-9701-06264c0b0fe2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:17.796347 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Found disk vdc by alias ua-699706de-e3f2-4c8c-9701-06264c0b0fe2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:17.796450 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Attempting to detach device vdc from instance a7a81f92-a39b-4a10-9868-39e256c3bc33 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:41:17.796796 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <alias name="ua-699706de-e3f2-4c8c-9701-06264c0b0fe2"/>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <serial>699706de-e3f2-4c8c-9701-06264c0b0fe2</serial>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:17.796796 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:17.802106 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully detached device vdc from instance a7a81f92-a39b-4a10-9868-39e256c3bc33 from the persistent domain config.
May 14 03:41:17.802291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] (1/8): Attempting to detach device vdc with device alias ua-699706de-e3f2-4c8c-9701-06264c0b0fe2 from instance a7a81f92-a39b-4a10-9868-39e256c3bc33 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:41:17.802558 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <alias name="ua-699706de-e3f2-4c8c-9701-06264c0b0fe2"/>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-2"/>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <serial>699706de-e3f2-4c8c-9701-06264c0b0fe2</serial>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:17.802558 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:17.809530 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba9e32f212f04cae8a70c44b26647a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f7491c96154009b61199ad430386d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:41:18.076212 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:41:18.076542 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730078.076323, aa344014-0ea0-498a-b2d4-eda732b0189d => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:18.076674 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] VM Paused (Lifecycle Event)
May 14 03:41:18.086700 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Took 14.32 seconds to spawn the instance on the hypervisor.
May 14 03:41:18.087373 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:18.236487 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:41:18.277254 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Found WWN 330000000b9fbdba8 for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000b9fbdba8', 'path': '/dev/dm-6', 'multipath_id': '330000000b9fbdba8'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9fbdba8', 'path': '/dev/dm-6', 'multipath_id': '330000000b9fbdba8'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.381s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:18.280609 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'flavor' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:18.315699 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:18.315699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '95')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:18.316516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '94')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:18.317059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b07987c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:18.317059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:18.317263 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flush multipath device 330000000180e3ffd {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:18.346110 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Successfully created port: 6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:41:18.365946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:18.380357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-699706de-e3f2-4c8c-9701-06264c0b0fe2 for instance a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:41:18.419014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:18.482552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:18.483414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:18.483654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:18.493546 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:18.493745 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:18.505496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.540703 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260]
May 14 03:41:18.540703 np0000000741 nova-compute[97948]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260] successful.
May 14 03:41:18.540703 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.558864 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.569914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.582674 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:18.584489 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730078.5841973, aa344014-0ea0-498a-b2d4-eda732b0189d => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:18.585900 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] VM Resumed (Lifecycle Event)
May 14 03:41:18.590278 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:18.601676 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Took 23.08 seconds to build instance.
May 14 03:41:18.611258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260]
May 14 03:41:18.611258 np0000000741 nova-compute[97948]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260] successful.
May 14 03:41:18.611258 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.633344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:18.633545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:18.633739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== disconnect_volume: return (2736ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:18.633912 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:18.637614 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:41:18.638216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7_resize/disk.config /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:18.682343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "cp -r /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7_resize/disk.config /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config" returned: 0 in 0.044s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:18.739603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:41:18.783961 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:18.784725 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:18.788526 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attempting to attach volume 37550fb5-203a-4ec4-873a-c12ccbe53e60 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:41:18.790492 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:   <alias name="ua-37550fb5-203a-4ec4-873a-c12ccbe53e60"/>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:   <serial>37550fb5-203a-4ec4-873a-c12ccbe53e60</serial>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:18.790492 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:41:18.914010 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Successfully updated port: 6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:41:18.974688 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-changed-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:18.974787 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Refreshing instance network info cache due to event network-changed-6a7592bc-64d2-477a-9da6-e59812eefc96. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:18.975063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] Acquiring lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:18.975133 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] Acquired lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:18.975201 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Refreshing network info cache for port 6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:19.087767 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:19.089775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:19.102749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-979ceaaf-dd77-4b34-b13c-99b379520d5a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.592s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:19.417947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:19.477674 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:19.560092 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:19.572673 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007503830001951428 future=<Future at 0x79d0b0775070 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:19.573245 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778730064.5717075, 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:19.574036 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] VM Stopped (Lifecycle Event)
May 14 03:41:19.574982 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:19.575170 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.28956236099998 future=<Future at 0x79d0b81e5eb0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:19.575269 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=11.28944572699993 future=<Future at 0x79d0b81e5eb0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:19.593127 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730079.592799, a7a81f92-a39b-4a10-9868-39e256c3bc33 => ua-699706de-e3f2-4c8c-9701-06264c0b0fe2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:41:19.596635 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully detached device vdc from instance a7a81f92-a39b-4a10-9868-39e256c3bc33 from the live domain config.
May 14 03:41:19.597739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:19.598246 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:19.598444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:19.598966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:19.599366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699706de-e3f2-4c8c-9701-06264c0b0fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:19.599603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:19.630292 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:19.630628 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:19.630628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '93')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:19.632272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2', '92')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:19.633306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0798f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:19.633539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:19.633813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flush multipath device 3300000008b44eac2 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:19.671262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:19.699697 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:19.718157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:19.749698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:41:19.750739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:41:19.750997 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Creating image(s)
May 14 03:41:19.751456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:19.751656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:19.753175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:19.755736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:19.756174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:19.757951 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:19.761891 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:19.763162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:19.776676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:19.778066 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:19.781600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:19.783624 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:19.784373 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:19.793601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:19.794506 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:19.805681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.817632 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:19.817632 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:19.847525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.40.100,3260]
May 14 03:41:19.847525 np0000000741 nova-compute[97948]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.40.100,3260] successful.
May 14 03:41:19.847525 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.855223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:19.855792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:19.856135 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:19.856595 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:19.859535 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:19.860749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:19.874553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.888634 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.920168 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Port 075309ef-fec3-45a6-adad-f9090f09ef1c binding to destination host np0000000741 is already ACTIVE {{(pid=97948) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 03:41:19.924274 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.50.100,3260]
May 14 03:41:19.924274 np0000000741 nova-compute[97948]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-699706de-e3f2-4c8c-9701-06264c0b0fe2, portal: 192.168.50.100,3260] successful.
May 14 03:41:19.924274 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.947312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:19.947771 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:19.951145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] <== disconnect_volume: return (352ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:19.951340 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:19.962038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:19.963201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:20.020768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk 1073741824" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:20.021226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:20.021562 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:20.077272 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1478a3-6668-4f01-a940-fb2e1ae830a7 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 8823e0e3-82fb-4e3c-bfc2-a3a3a37006c9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:20.114266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:20.114838 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:41:20.115806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:20.199175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:20.199548 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Cannot resize image /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:41:20.200139 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:41:20.200321 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Ensure instance console log exists: /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:41:20.200652 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:20.200914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:20.201072 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:20.201564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1188f6b7-87e5-4d5b-9452-2a307fed353c req-ba57b2cd-cbff-4ffe-8ace-25d234524233 service nova] Releasing lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:20.201955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquired lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:20.202098 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:20.263038 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:20.486857 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:20.486991 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:20.487142 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:20.487265 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:3a:ff:89, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:20.525113 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'flavor' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:20.634230 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:20.634900 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:20.634900 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:20.634900 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:20.635080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:20.639949 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Terminating instance
May 14 03:41:20.781986 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:20.890288 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:20.929203 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:41:20.937239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:20.937786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:20.937950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:20.974030 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:21.094132 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating instance_info_cache with network_info: [{"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:21.143401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:41:21.173696 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.175705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.193955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.196737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.218553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.270570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:21.369521 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:21.369521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:21.369741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:21.369908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:21.370069 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] No waiting events found dispatching network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:21.370186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dc48909f-7182-42db-a5e9-9bac8864a4f3 req-f31de706-814e-4114-95da-6716c986167b service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:21.464822 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.9996821740001 future=<Future at 0x79d0b070a0f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:21.466883 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Instance destroyed successfully.
May 14 03:41:21.467701 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid aa344014-0ea0-498a-b2d4-eda732b0189d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:21.530246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0809b34c-50ae-4011-a9ef-ffaeb87c232c tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.302s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:21.596329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Releasing lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:21.596651 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance network_info: |[{"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:41:21.598380 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Start _get_guest_xml network_info=[{"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:21.600599 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:21.601784 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1824173494', uuid='4307e5f7-29b9-4320-8fa8-454bf5e15df6'), owner=OwnerMeta(userid='ba9e32f212f04cae8a70c44b26647a59', username='tempest-AttachVolumeNegativeTest-1381632340-project-member', projectid='61f7491c96154009b61199ad430386d3', projectname='tempest-AttachVolumeNegativeTest-1381632340'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730081.6014404) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:21.602754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:21.603053 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:21.603947 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:21.604147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:21.605386 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:21.605678 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:21.605831 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:21.605923 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:21.606034 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:21.606117 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:21.606215 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:21.606348 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:21.606445 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:21.606548 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:21.606663 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:21.607224 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:21.617923 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173494',display_name='tempest-AttachVolumeNegativeTest-server-1824173494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1824173494',id=39,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoO24CVwVPACn2OkCDXECLoMO9dFffKETeq4hZPQmdtdlXRG1Lyl4DMYBlEYHIzJBqoO1eZWTVh+Mp2mzni+V1k61zItRXu7ldtrWwrXaTl7U8W+/MzArgdSAzbFHEPng==',key_name='tempest-keypair-1990707281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-rnv4itm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=4307e5f7-29b9-4320-8fa8-454bf5e15df6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:21.618108 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:21.618546 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:21.619008 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'pci_devices' on Instance uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:21.783255 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:21.783625 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.20 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:21.948325 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:21.969901 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279321093',display_name='tempest-TestVolumeBootPattern-server-279321093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-279321093',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:18Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-n5i064ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:41:18Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=aa344014-0ea0-498a-b2d4-eda732b0189d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:41:21.970120 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "address": "fa:16:3e:6a:76:bf", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab1377-29", "ovs_interfaceid": "c0ab1377-2999-44fb-b940-43667ecd7f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:21.970585 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:21.970874 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:41:21.972074 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.972271 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ab1377-29, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:21.975147 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:21.975616 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.975734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f93968d3-f399-4ae0-8882-6b865468a180) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:21.976193 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.976727 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:21.977401 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:21.980300 np0000000741 nova-compute[97948]: INFO os_vif [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=c0ab1377-2999-44fb-b940-43667ecd7f3c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab1377-29')
May 14 03:41:21.983047 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:21.983757 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:21.983963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:21.984369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:21.985002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d08a677-66dd-4256-86b0-6169bf67633c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:21.985002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:21.985540 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:22.012432 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:22.013015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:22.013015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '97')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:22.014705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c', '96')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:22.014705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01efe20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:22.014868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:22.015082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 3300000001d388906 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:22.030122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-463a6e90-3743-4340-9ed0-902a8893a4e6 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.526s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:22.054548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:22.061917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:22.062087 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:22.062135 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:22.103259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:22.121531 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <uuid>4307e5f7-29b9-4320-8fa8-454bf5e15df6</uuid>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <name>instance-00000027</name>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1824173494</nova:name>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:21</nova:creationTime>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:user uuid="ba9e32f212f04cae8a70c44b26647a59">tempest-AttachVolumeNegativeTest-1381632340-project-member</nova:user>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:project uuid="61f7491c96154009b61199ad430386d3">tempest-AttachVolumeNegativeTest-1381632340</nova:project>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         <nova:port uuid="6a7592bc-64d2-477a-9da6-e59812eefc96">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="serial">4307e5f7-29b9-4320-8fa8-454bf5e15df6</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="uuid">4307e5f7-29b9-4320-8fa8-454bf5e15df6</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.config"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3b:ed:6e"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <target dev="tap6a7592bc-64"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/console.log" append="off"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:22.121531 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Preparing to wait for external event network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173494',display_name='tempest-AttachVolumeNegativeTest-server-1824173494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1824173494',id=39,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoO24CVwVPACn2OkCDXECLoMO9dFffKETeq4hZPQmdtdlXRG1Lyl4DMYBlEYHIzJBqoO1eZWTVh+Mp2mzni+V1k61zItRXu7ldtrWwrXaTl7U8W+/MzArgdSAzbFHEPng==',key_name='tempest-keypair-1990707281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-rnv4itm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=4307e5f7-29b9-4320-8fa8-454bf5e15df6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:41:22.123902 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.124358 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:22.124358 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:41:22.125234 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.125416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b342f299-d718-5837-b623-de9ee4a17b4f', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:22.126153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.126861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:22.128227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.129919 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.130083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a7592bc-64, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:22.130344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a7592bc-64, col_values=(('qos', UUID('2a516d3a-d560-46df-a8bc-e2abad4dffc8')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:22.130492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a7592bc-64, col_values=(('external_ids', {'iface-id': '6a7592bc-64d2-477a-9da6-e59812eefc96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ed:6e', 'vm-uuid': '4307e5f7-29b9-4320-8fa8-454bf5e15df6'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:22.131166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.132703 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:22.137472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:22.138267 np0000000741 nova-compute[97948]: INFO os_vif [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64')
May 14 03:41:22.163347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:22.163451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:22.164331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:22.175066 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:22.175228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:22.186108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.221374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.40.100,3260]
May 14 03:41:22.221374 np0000000741 nova-compute[97948]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.40.100,3260] successful.
May 14 03:41:22.221374 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.235485 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.246227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.281674 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.50.100,3260]
May 14 03:41:22.281674 np0000000741 nova-compute[97948]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-1d08a677-66dd-4256-86b0-6169bf67633c, portal: 192.168.50.100,3260] successful.
May 14 03:41:22.281674 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.297903 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:22.299215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:22.299409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (315ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:22.299571 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:22.299885 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Deleting instance files /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d_del
May 14 03:41:22.300369 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Deletion of /opt/stack/data/nova/instances/aa344014-0ea0-498a-b2d4-eda732b0189d_del complete
May 14 03:41:22.326298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.326473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.326686 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attaching volume a89b4283-10ad-4dec-8d51-5b7441ba20ff to /dev/vdc
May 14 03:41:22.356518 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Rescuing
May 14 03:41:22.356767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:22.356935 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:22.357145 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:22.364869 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:22.376358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:22.398384 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:22.441410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:22.441958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:22.451679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:22.453203 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:fedd:c554', 'fe80::5489:a1ff:fe15:6f48'] 
May 14 03:41:22.453420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:22.453542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:22.453855 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:22.454128 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating existing volume attachment record: e7c717a8-5236-4c75-bb79-ce742d8326e7 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:41:22.493433 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid d2a0afdf-49df-42a9-b430-11871f7a16ef {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.494620 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.494907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.496197 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.497129 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.498031 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.498346 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.498805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.499125 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.499419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.499564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.500037 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.500667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.502653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid aa344014-0ea0-498a-b2d4-eda732b0189d {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.502852 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.502962 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:41:22.503262 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.28 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:22.504433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.504837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.504837 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] During sync_power_state the instance has a pending task (rescuing). Skip.
May 14 03:41:22.505137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:22.505184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.505335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.505461 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] During sync_power_state the instance has a pending task (resize_migrated). Skip.
May 14 03:41:22.505599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:22.505780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.569060 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:22.571872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.572093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.572311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:22.572427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:22.572582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:22.574703 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Terminating instance
May 14 03:41:22.783219 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:22.783552 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:22.784042 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:41:22.784042 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:22.806269 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Took 1.66 seconds to destroy the instance on the hypervisor.
May 14 03:41:22.806982 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:41:22.807324 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:41:22.807484 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:41:22.807757 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:22.845320 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:22.859496 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:22.881629 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:22.987235 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:23.004474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:23.005024 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:23.007464 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:23.007914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:23.008068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:23.008574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:23.008874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:23.010969 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:23.011161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:23.012664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:23.021962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:23.022853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:23.023402 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:23.023595 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:23.024221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:23.024893 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:23.035112 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:23.035112 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:23.040550 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:23.040550 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:23.050316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff] added
May 14 03:41:23.050316 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:23.050316 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:23.050316 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:23.050316 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:23.050316 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:23.050316 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:23.050585 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:23.050728 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:23.050949 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:23.054614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff] added
May 14 03:41:23.054614 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:23.054614 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:23.054614 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:23.054614 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:23.054614 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:23.054614 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:23.055241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:23.055414 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:23.055492 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:23.077731 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:41:23.118305 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.139571 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.171724 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c06b2900-0004-4fd1-a75c-f1659fbe6018 req-54dfc432-2e75-438c-8115-31a405c3ec03 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-deleted-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:23.172213 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-c06b2900-0004-4fd1-a75c-f1659fbe6018 req-54dfc432-2e75-438c-8115-31a405c3ec03 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Neutron deleted interface c0ab1377-2999-44fb-b940-43667ecd7f3c; detaching it from the instance and deleting it from the info cache
May 14 03:41:23.172438 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.172658 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c06b2900-0004-4fd1-a75c-f1659fbe6018 req-54dfc432-2e75-438c-8115-31a405c3ec03 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:23.236902 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:23.372014 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:23.409870 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999638022999989 future=<Future at 0x79d0b8296b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:23.412532 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Instance destroyed successfully.
May 14 03:41:23.412944 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'resources' on Instance uuid a7a81f92-a39b-4a10-9868-39e256c3bc33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:23.440848 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:23.440985 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] Acquiring lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:23.441134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:23.441487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:23.441487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] No waiting events found dispatching network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:23.441487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1d2f399-94e7-408c-9683-01b8f15d2e9f req-8991f921-4aeb-4002-85b6-aa4d34038934 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Received event network-vif-unplugged-c0ab1377-2999-44fb-b940-43667ecd7f3c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:23.489001 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:23.615781 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:23.658005 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:23.658160 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:23.658350 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:3b:ed:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:23.659072 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Using config drive
May 14 03:41:23.678044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c06b2900-0004-4fd1-a75c-f1659fbe6018 req-54dfc432-2e75-438c-8115-31a405c3ec03 service nova] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Detach interface failed, port_id=c0ab1377-2999-44fb-b940-43667ecd7f3c, reason: Instance aa344014-0ea0-498a-b2d4-eda732b0189d could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:41:23.784164 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:23.784662 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:23.874795 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:23.915311 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1674772814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-1674772814',id=30,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzAVkeN8U7bIwitu7X+vC8w6QVojMw7Hmjcxq0rXUC5esnPDvt1R9j1YT6MZzhOjqqK8fZ8utHrFjDuzFxepKMS4Kjts4MxrrWr/TtvDtPavQDqzqyqyE2Mi+uBEsy1oA==',key_name='tempest-keypair-1288155932',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:39Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-7ib3ohsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=a7a81f92-a39b-4a10-9868-39e256c3bc33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:41:23.915524 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "25254b82-6c2d-4326-b9f8-543a5c64160d", "address": "fa:16:3e:dd:c5:54", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25254b82-6c", "ovs_interfaceid": "25254b82-6c2d-4326-b9f8-543a5c64160d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:23.916058 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:23.916292 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:41:23.917588 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.917985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25254b82-6c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:23.920604 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:23.925675 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.926501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.926707 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84ed0db0-4aef-45b2-bfe7-b9c738b57142) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:23.927478 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.928116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:23.933535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:23.935797 np0000000741 nova-compute[97948]: INFO os_vif [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=25254b82-6c2d-4326-b9f8-543a5c64160d,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25254b82-6c')
May 14 03:41:23.936053 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Deleting instance files /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33_del
May 14 03:41:23.943249 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Deletion of /opt/stack/data/nova/instances/a7a81f92-a39b-4a10-9868-39e256c3bc33_del complete
May 14 03:41:23.997885 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:24.007395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:24.028005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:24.052097 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:24.056687 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:24.065928 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:24.065928 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.067762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:24.067762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:24.073972 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:24.073972 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.081931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:24.083153 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe02:d20', 'fe80::2cb0:f7ff:fe5b:d8bb', 'fe80::fc16:3eff:fe3a:ff89'] 
May 14 03:41:24.083259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:24.083408 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:24.083738 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:24.086722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.088412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.100621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.100621 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.100621 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.100621 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.100621 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:24.100836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.100836 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.100836 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.100836 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.100836 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:24.105345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.105345 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.105345 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.105345 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.105345 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:24.105513 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.105513 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.105513 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.105513 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.105513 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:24.118328 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Took 1.31 seconds to deallocate network for instance.
May 14 03:41:24.149673 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.40.100,3260]
May 14 03:41:24.149673 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.40.100,3260] successful.
May 14 03:41:24.149673 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.155848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.50.100,3260]
May 14 03:41:24.155848 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.50.100,3260] successful.
May 14 03:41:24.155848 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.166402 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:24.169380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.169975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.184251 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.185753 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:24.187619 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:24.188226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:24.188226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:24.189493 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] HCTL ('8', '-', '-', 0) found on session 103 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:24.189608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:24.190160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] HCTL ('7', '-', '-', 0) found on session 102 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:24.190332 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:24.222208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching for a device in session 102 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:24.222208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:24.225533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Searching for a device in session 103 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:24.225533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:24.327059 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Creating config drive at /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.config
May 14 03:41:24.331183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9ep657vm {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:24.385566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9ep657vm" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:24.452501 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:41:24.453431 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:41:24.453965 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:41:24.454064 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:41:24.454547 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:24.579196 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:24.680233 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:41:24.783399 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:24.826977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:24.854202 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:24.856497 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:24.963115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.024280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:41:25.123863 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5cc94483-2282-41fd-b77a-b428a4686e69 req-dd9b7423-177c-483e-91c3-7a41a594f67d service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-deleted-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:25.124102 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-5cc94483-2282-41fd-b77a-b428a4686e69 req-dd9b7423-177c-483e-91c3-7a41a594f67d service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Neutron deleted interface 25254b82-6c2d-4326-b9f8-543a5c64160d; detaching it from the instance and deleting it from the info cache
May 14 03:41:25.124202 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5cc94483-2282-41fd-b77a-b428a4686e69 req-dd9b7423-177c-483e-91c3-7a41a594f67d service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:25.152185 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.154027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.157354 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.178368 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.187622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.187946 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.248673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Starting finish_migration {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 03:41:25.249695 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:41:25.249801 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Creating image(s)
May 14 03:41:25.250163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:41:25.250163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:41:25.250511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.250511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.250618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:25.251214 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start _get_guest_xml network_info=[{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7', 'attached_at': '2026-05-14T03:41:24.000000', 'detached_at': '', 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'serial': 'e09e7940-a866-4f94-87b2-96b23f9ea816'}, 'boot_index': 0, 'attachment_id': 'bafdcf51-86ce-43ee-bfd5-5ab017301831', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:25.257275 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:25.258317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.258503 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.258669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:25.258861 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:25.259037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:25.259910 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:25.260071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Acquiring lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.260298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.260404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:25.260548 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] No waiting events found dispatching network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:25.264655 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:25.266182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Received event network-vif-unplugged-25254b82-6c2d-4326-b9f8-543a5c64160d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:25.266581 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1795803912', uuid='3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7'), owner=OwnerMeta(userid='71a50ef37e66489cbf8dc1dde0950769', username='tempest-ServerActionsTestOtherA-882285516-project-member', projectid='37a8404c7d33468cab5b1fb42b63d221', projectname='tempest-ServerActionsTestOtherA-882285516'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730085.265677) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:25.266973 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:25.267099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.267332 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.267451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:25.267584 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-98ed6846-1d7c-4a24-b2af-6c41d54d2cc8 req-14cfa075-0667-4908-84d7-352a6f4a2d51 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Processing event network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:41:25.270735 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:25.271110 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:25.272884 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:25.273070 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:25.274272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:25.275076 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:25.275290 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:25.275395 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:25.275539 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:25.275676 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:25.275852 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:25.276032 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:25.276163 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:25.276303 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:25.276433 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:25.276578 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:25.291384 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.291797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:25.385789 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:25.386249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:25.386520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:25.387175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:25.387628 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:25.388101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:25.388279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:25.500035 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.503669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.523592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.547701 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:25.631179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.632685 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5cc94483-2282-41fd-b77a-b428a4686e69 req-dd9b7423-177c-483e-91c3-7a41a594f67d service nova] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Detach interface failed, port_id=25254b82-6c2d-4326-b9f8-543a5c64160d, reason: Instance a7a81f92-a39b-4a10-9868-39e256c3bc33 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:41:25.637886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:25.696074 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:41:25.696800 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730085.696218, 4307e5f7-29b9-4320-8fa8-454bf5e15df6 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:25.697127 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] VM Started (Lifecycle Event)
May 14 03:41:25.703373 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:41:25.708246 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance spawned successfully.
May 14 03:41:25.708725 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:41:25.787624 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:25.788158 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:25.827075 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance destroyed successfully.
May 14 03:41:25.827555 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'numa_topology' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:26.041449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found WWN 330000000f15d7c96 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:26.041896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:26.042044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000f15d7c96', 'path': '/dev/dm-0', 'multipath_id': '330000000f15d7c96'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:26.042215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f15d7c96', 'path': '/dev/dm-0', 'multipath_id': '330000000f15d7c96'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:26.042764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.654s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:26.042975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:26.045409 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:26.050874 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Took 1.60 seconds to deallocate network for instance.
May 14 03:41:26.059096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:26.059286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:26.060158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:26.061148 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:26.062664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:26.062664 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:26.075338 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:26.075338 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:26.081114 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:26.081114 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:26.093315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816] added
May 14 03:41:26.093315 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:26.093315 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:26.093315 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:26.093315 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:26.093315 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:26.093315 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:26.093470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:26.093656 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:26.093965 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:26.096275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816] added
May 14 03:41:26.096275 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:26.096275 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:26.096275 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:26.096275 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:26.096275 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:26.096275 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:26.096450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:26.096491 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:26.097101 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:26.202396 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:26.210324 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:26.216108 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.216239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.216630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.216937 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.217249 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.217618 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:26.292788 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:26.336710 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attempting rescue
May 14 03:41:26.336710 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97948) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 03:41:26.344146 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:41:26.344343 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Creating image(s)
May 14 03:41:26.345581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:26.345857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:26.346425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:26.346646 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:26.548370 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attempting to attach volume a89b4283-10ad-4dec-8d51-5b7441ba20ff with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:41:26.549540 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:   <alias name="ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff"/>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:   <serial>a89b4283-10ad-4dec-8d51-5b7441ba20ff</serial>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:26.549540 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:41:26.561332 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:26.713994 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:41:26.714284 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730086.714065, 4307e5f7-29b9-4320-8fa8-454bf5e15df6 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:26.714284 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] VM Paused (Lifecycle Event)
May 14 03:41:26.723922 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Took 6.97 seconds to spawn the instance on the hypervisor.
May 14 03:41:26.724044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:26.799205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.611s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:26.802077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:26.802460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:26.803056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.241s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:26.803260 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:41:26.848680 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:26.849182 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:26.858771 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:26.861996 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:26.862343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:26.862850 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:26.869923 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:26.869923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:26.897846 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance aa344014-0ea0-498a-b2d4-eda732b0189d
May 14 03:41:26.971285 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:26.971764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.rescue {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:27.043975 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.rescue" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:27.045336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.045336 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'migration_context' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:27.094413 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:27.098530 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:27.109492 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:27.109492 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:27.119918 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:27.119918 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.128456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.134802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.145184 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.145373 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.152375 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.152732 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:27.189157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260]
May 14 03:41:27.189157 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260] successful.
May 14 03:41:27.189157 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.196302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260]
May 14 03:41:27.196302 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260] successful.
May 14 03:41:27.196302 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.203904 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.217376 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:27.219078 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.225227 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.225548 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:27.226060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:27.226126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:27.228314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('9', '-', '-', 0) found on session 104 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:27.228472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:27.233896 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730087.2335339, 4307e5f7-29b9-4320-8fa8-454bf5e15df6 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:27.234393 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] VM Resumed (Lifecycle Event)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.240954 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:27.241158 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Took 12.61 seconds to build instance.
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:27.242710 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:27.242710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:27.249247 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] HCTL ('10', '-', '-', 0) found on session 105 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:27.249400 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:27.249957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 104 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:27.250000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:27.271618 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:27.362008 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:27.362258 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:27.362964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:27.363103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.363309 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] No waiting events found dispatching network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:27.363497 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received unexpected event network-vif-plugged-6a7592bc-64d2-477a-9da6-e59812eefc96 for instance with vm_state active and task_state None.
May 14 03:41:27.363666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:27.363888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:27.364046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:27.364197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.364354 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:27.364555 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state active and task_state rescuing.
May 14 03:41:27.366546 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:27.367261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:27.367836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:27.368877 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.368970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:27.369151 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d1913c80-af39-4f4f-8bbe-53911c176894 req-f07278cd-ceb4-40d4-ab2d-f35251dcc4ef service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state active and task_state rescuing.
May 14 03:41:27.517110 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:27.517261 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:27.547734 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:27.547965 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:41:27.548743 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start _get_guest_xml network_info=[{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:3a:ff:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:27.548743 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:27.746089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2dbcfa11-6bb6-4410-8752-f819376a36c1 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.124s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.746328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.742s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:27.746509 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:41:27.746666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.747556 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:27.749294 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:27.850740 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:27.917141 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e5d6ac85-9974-4a82-8bbd-c77d0bd1bee8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.282s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.917709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.412s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:27.917938 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] During sync_power_state the instance has a pending task (deleting). Skip.
May 14 03:41:27.918137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "aa344014-0ea0-498a-b2d4-eda732b0189d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:27.955948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:27.956472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.022333 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:28.050678 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:28.051356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.056817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.057928 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:28.060291 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-662956973', uuid='eb70716b-7c1c-4efe-aec2-f2780ad6ebff'), owner=OwnerMeta(userid='2bde0629c78549de8126765cd827cd82', username='tempest-ServerRescueNegativeTestJSON-1232860846-project-member', projectid='b3eb60c511814747813d717f2e02a441', projectname='tempest-ServerRescueNegativeTestJSON-1232860846'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:3a:ff:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730088.059763) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:28.087780 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:28.088758 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:28.092372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:28.092854 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:28.094862 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:28.095355 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:28.095523 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:28.096120 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:28.096328 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:28.096509 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:28.096725 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:28.096933 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:28.097082 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:28.097607 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:28.097819 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:28.098244 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:28.098533 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:28.171096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.171630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.224977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:28.225150 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:28.225290 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:28.225386 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:28.226256 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] No VIF found with MAC fa:16:3e:02:0d:20, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:28.252556 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99965326000006 future=<Future at 0x79d0b0785670 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:28.269317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:28.269514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:28.288744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.291137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.370382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-changed-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:28.370886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Refreshing instance network info cache due to event network-changed-6a7592bc-64d2-477a-9da6-e59812eefc96. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:28.371122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] Acquiring lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:28.371259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] Acquired lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:28.371430 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Refreshing network info cache for port 6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:28.380139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.380510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.470599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.471039 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:41:28.475205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.535535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.733s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:28.573258 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.573756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.593333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:28.599500 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Deleted allocations for instance a7a81f92-a39b-4a10-9868-39e256c3bc33
May 14 03:41:28.605810 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:28.622173 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-662956973',display_name='tempest-ServerRescueNegativeTestJSON-server-662956973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-662956973',id=36,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7S4Hb/1r7evPWnzpybLs/rQIHvlRkCmm0YMZ82RxabhV5HSa0Qay9MVzDwNTpQMzvBRb4viSkxF789Or+6y5CmCDfP6sK5y7rZMpxyAz7n/ybMC9T/sTzhjFhteSeoxw==',key_name='tempest-keypair-104550465',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:34Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-55ih66j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bde0629c78549de8126765cd827cd82',uuid=eb70716b-7c1c-4efe-aec2-f2780ad6ebff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:3a:ff:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:28.622713 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "vif_mac": "fa:16:3e:3a:ff:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:28.623650 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:28.624614 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'pci_devices' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:28.686419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.686797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:41:28.686911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:41:28.689985 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:41:28.691384 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.776784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.777455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.859758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.082s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.860509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:28.876072 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:28.928770 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:28.949846 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:28.951318 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:29.046675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:29.051049 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:29.110189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Found WWN 330000000180e3ffd for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:29.110835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.068s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:29.111172 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== connect_volume: return (3722ms) {'type': 'block', 'scsi_wwn': '330000000180e3ffd', 'path': '/dev/dm-1', 'multipath_id': '330000000180e3ffd'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:29.111408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000180e3ffd', 'path': '/dev/dm-1', 'multipath_id': '330000000180e3ffd'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:29.127254 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:29.129109 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <uuid>eb70716b-7c1c-4efe-aec2-f2780ad6ebff</uuid>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <name>instance-00000024</name>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-662956973</nova:name>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:28</nova:creationTime>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:user uuid="2bde0629c78549de8126765cd827cd82">tempest-ServerRescueNegativeTestJSON-1232860846-project-member</nova:user>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:project uuid="b3eb60c511814747813d717f2e02a441">tempest-ServerRescueNegativeTestJSON-1232860846</nova:project>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         <nova:port uuid="81eb0073-bed0-4c79-86a8-bb56d5861294">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="serial">eb70716b-7c1c-4efe-aec2-f2780ad6ebff</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="uuid">eb70716b-7c1c-4efe-aec2-f2780ad6ebff</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.rescue"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config.rescue"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3a:ff:89"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <target dev="tap81eb0073-be"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/console.log" append="off"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:29.129109 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:29.140036 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance destroyed successfully.
May 14 03:41:29.146825 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:29.147356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:29.241221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:29.256337 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:29.257299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:29.316415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:29.316828 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12759MB free_disk=73.05887222290039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:41:29.317049 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:29.317264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:29.331442 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:29.513085 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updated VIF entry in instance network info cache for port 6a7592bc-64d2-477a-9da6-e59812eefc96. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:29.513085 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating instance_info_cache with network_info: [{"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:29.621262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cba4ee7e-d36b-42e6-887e-bd9f08fd81de tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.049s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:29.622074 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.611s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:29.634406 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:29.635674 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:29.636764 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:29.641944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <uuid>3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</uuid>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <name>instance-00000025</name>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <memory>262144</memory>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServerActionsTestOtherA-server-1795803912</nova:name>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:25</nova:creationTime>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.micro" id="84">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:memory>256</nova:memory>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:user uuid="71a50ef37e66489cbf8dc1dde0950769">tempest-ServerActionsTestOtherA-882285516-project-member</nova:user>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:project uuid="37a8404c7d33468cab5b1fb42b63d221">tempest-ServerActionsTestOtherA-882285516</nova:project>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         <nova:port uuid="075309ef-fec3-45a6-adad-f9090f09ef1c">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="serial">3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="uuid">3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/disk.config"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <alias name="ua-e09e7940-a866-4f94-87b2-96b23f9ea816"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <serial>e09e7940-a866-4f94-87b2-96b23f9ea816</serial>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:92:8e:da"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <target dev="tap075309ef-fe"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7/console.log" append="off"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:29.641944 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-97994626-network", "vif_mac": "fa:16:3e:92:8e:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.646437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1941d75d-b2c8-5de8-8a34-38c1d4d65727', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:29.648451 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.648895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:29.654673 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.655217 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.655387 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap075309ef-fe, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:29.655779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap075309ef-fe, col_values=(('qos', UUID('2cc08240-5c92-4432-87db-9240a727bd9d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:29.656189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap075309ef-fe, col_values=(('external_ids', {'iface-id': '075309ef-fec3-45a6-adad-f9090f09ef1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8e:da', 'vm-uuid': '3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:29.656956 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.660333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:29.668841 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:29.670684 np0000000741 nova-compute[97948]: INFO os_vif [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe')
May 14 03:41:29.813813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3933a6c9-71d2-4507-b53d-356d216d8a16 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.487s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:29.814410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.314s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:30.013674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4983dbc8-ac42-43b6-a4f7-f9f08f840d80 req-cecd5815-b240-4bc6-a169-7716beb6d0b4 service nova] Releasing lock "refresh_cache-4307e5f7-29b9-4320-8fa8-454bf5e15df6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:30.124764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "a7a81f92-a39b-4a10-9868-39e256c3bc33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.503s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:30.276794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:30.325188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:30.326491 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.049s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:30.331207 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Applying migration context for instance 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 as it has an incoming, in-progress migration dbed985f-5058-428e-9c18-890a53db0040. Migration status is post-migrating {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 14 03:41:30.332177 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating resource usage from migration dbed985f-5058-428e-9c18-890a53db0040
May 14 03:41:30.383757 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d2a0afdf-49df-42a9-b430-11871f7a16ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.383848 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.383949 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.384024 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 18681230-9203-4956-8193-a5cde97a52fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.384109 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.384194 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Migration dbed985f-5058-428e-9c18-890a53db0040 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 03:41:30.384266 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.384342 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:41:30.384513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:41:30.384652 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2112MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:41:29 up 33 min,  2 users,  load average: 6.63, 6.78, 4.12\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_37a8404c7d33468cab5b1fb42b63d221': '2', 'io_workload': '1', 'num_proj_b3eb60c511814747813d717f2e02a441': '3', 'num_vm_rescued': '1', 'num_proj_e302048ab6a04960bceff08f245070e5': '1', 'num_task_rescuing': '1', 'num_task_resize_finish': '1', 'num_proj_61f7491c96154009b61199ad430386d3': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:41:30.689738 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:30.692661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:30.692661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:30.692661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] No VIF found with MAC fa:16:3e:3a:ff:89, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:30.692661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Using config drive
May 14 03:41:30.836720 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Detaching volume a89b4283-10ad-4dec-8d51-5b7441ba20ff
May 14 03:41:30.859477 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:30.859745 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:30.865162 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00040798000009090174 future=<Future at 0x79d0b81e5eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:30.866254 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Emitting event <LifecycleEvent: 1778730075.8646293, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:30.866280 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:30.866521 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.598070575000065 future=<Future at 0x79d0b070a0f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:30.866521 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.597990325999945 future=<Future at 0x79d0b070a0f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:30.867455 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Stopped (Lifecycle Event)
May 14 03:41:30.882914 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attempting to driver detach volume a89b4283-10ad-4dec-8d51-5b7441ba20ff from mountpoint /dev/vdc
May 14 03:41:30.886036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found disk vdc by alias ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:30.887069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found disk vdc by alias ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:30.887183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Attempting to detach device vdc from instance 18681230-9203-4956-8193-a5cde97a52fa from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:41:30.887384 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <alias name="ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff"/>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <serial>a89b4283-10ad-4dec-8d51-5b7441ba20ff</serial>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:30.887384 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:30.893346 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully detached device vdc from instance 18681230-9203-4956-8193-a5cde97a52fa from the persistent domain config.
May 14 03:41:30.893505 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] (1/8): Attempting to detach device vdc with device alias ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff from instance 18681230-9203-4956-8193-a5cde97a52fa from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:41:30.893747 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <alias name="ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff"/>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <serial>a89b4283-10ad-4dec-8d51-5b7441ba20ff</serial>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:30.893747 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:31.193556 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'ec2_ids' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:31.197315 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:31.197408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:31.197524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] No VIF found with MAC fa:16:3e:92:8e:da, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:31.197947 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Using config drive
May 14 03:41:31.362103 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:31.372403 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-28219329-b764-413d-ad8f-66c48b355fcb tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:31.411507 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730091.4111354, 18681230-9203-4956-8193-a5cde97a52fa => ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:41:31.415859 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a89b4283-10ad-4dec-8d51-5b7441ba20ff for instance 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:41:31.420192 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully detached device vdc from instance 18681230-9203-4956-8193-a5cde97a52fa from the live domain config.
May 14 03:41:31.423097 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:31.423382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:31.423522 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:31.423883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:31.424163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a89b4283-10ad-4dec-8d51-5b7441ba20ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:31.424312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:31.453125 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:31.453363 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:31.453363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:31.453563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', '102')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:31.455075 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff', '103')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:31.455670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b829a480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:31.456307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:31.456307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Flush multipath device 330000000f15d7c96 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:31.488582 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:31.541022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:31.587126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:31.587282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:31.588846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:31.601536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:31.601740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:31.611097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.660461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.40.100,3260]
May 14 03:41:31.660461 np0000000741 nova-compute[97948]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.40.100,3260] successful.
May 14 03:41:31.660461 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.684993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.699228 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:31.699228 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'keypairs' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:31.700876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.737066 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.50.100,3260]
May 14 03:41:31.737066 np0000000741 nova-compute[97948]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-a89b4283-10ad-4dec-8d51-5b7441ba20ff, portal: 192.168.50.100,3260] successful.
May 14 03:41:31.737066 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.755118 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:31.755427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:31.755617 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== disconnect_volume: return (331ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:31.755791 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:31.803137 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:31.829751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:31.868788 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:41:31.868934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.552s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:31.869277 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:31.910969 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:31.941746 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:31.948535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:32.077966 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:32.078135 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:32.078264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:32.078374 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:32.078495 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:32.078651 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-edb5a8f9-189a-47df-8c76-ad19bb918ff9 req-62ea92e5-5c85-46d5-a5fb-55a1f210d736 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received unexpected event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with vm_state active and task_state resize_finish.
May 14 03:41:32.097483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:32.097871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:32.140022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:32.140022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:32.202990 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:32.205801 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:32.300011 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:32.320261 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Creating config drive at /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config.rescue
May 14 03:41:32.324097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdbxw1878 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:32.373069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdbxw1878" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:32.601754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:41:32.607015 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730092.605459, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:32.607015 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Resumed (Lifecycle Event)
May 14 03:41:32.608212 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:41:32.611954 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance running successfully.
May 14 03:41:32.616724 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Failed to set time: agent not configured {{(pid=97948) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 03:41:32.616724 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-75d0ba53-37fc-42e3-bfcb-556fe5089880 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] finish_migration finished successfully. {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 03:41:32.641061 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:41:32.805407 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:32.836684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:32.863283 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:41:32.863845 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.91 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:41:32.930305 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:32.949512 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:32.950441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:33.011841 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:33.013666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:33.014266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:33.014416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:33.014552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:33.014836 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a886586a-dc99-49b4-820c-029d1f95a339 req-a0000378-fa87-45d1-8265-20b621735893 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state active and task_state rescuing.
May 14 03:41:33.115701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:33.121848 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:33.202723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:33.202723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:33.207693 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:41:33.207693 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Claim successful on node np0000000741
May 14 03:41:33.214240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:33.314449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-425240be-5e72-4201-a753-359bdf74f440 tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.988s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:33.593923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:33.626954 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:41:33.627196 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730093.62701, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:33.627328 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Started (Lifecycle Event)
May 14 03:41:33.728653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:33.728833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:33.740618 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0293f95d-2593-4aad-87cb-9aab08216c43 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:34.130054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:34.133157 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:34.167843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:34.168005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:34.169370 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:34.169632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:34.169758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:34.169852 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-88920315-69b9-4962-b267-8c2f62050ce2 req-18769a80-c63e-42da-be05-12aed87eb8b9 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received unexpected event network-vif-plugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with vm_state resized and task_state None.
May 14 03:41:34.231895 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Detaching volume a575292f-fbda-488f-884c-dba6e6653b52
May 14 03:41:34.302218 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Attempting to driver detach volume a575292f-fbda-488f-884c-dba6e6653b52 from mountpoint /dev/vdb
May 14 03:41:34.307599 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found disk vdb by alias ua-a575292f-fbda-488f-884c-dba6e6653b52 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:34.308690 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Found disk vdb by alias ua-a575292f-fbda-488f-884c-dba6e6653b52 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:41:34.308779 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Attempting to detach device vdb from instance 18681230-9203-4956-8193-a5cde97a52fa from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:41:34.309564 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <alias name="ua-a575292f-fbda-488f-884c-dba6e6653b52"/>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <serial>a575292f-fbda-488f-884c-dba6e6653b52</serial>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:34.309564 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:34.321482 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully detached device vdb from instance 18681230-9203-4956-8193-a5cde97a52fa from the persistent domain config.
May 14 03:41:34.322274 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] (1/8): Attempting to detach device vdb with device alias ua-a575292f-fbda-488f-884c-dba6e6653b52 from instance 18681230-9203-4956-8193-a5cde97a52fa from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:41:34.322274 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <alias name="ua-a575292f-fbda-488f-884c-dba6e6653b52"/>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <serial>a575292f-fbda-488f-884c-dba6e6653b52</serial>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]: </disk>
May 14 03:41:34.322274 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:41:34.635308 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for eb70716b-7c1c-4efe-aec2-f2780ad6ebff due to new event <LifecycleEvent: 1778730094.634995, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:41:34.636712 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730094.634995, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:34.636712 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Resumed (Lifecycle Event)
May 14 03:41:34.657726 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:34.821817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:34.822004 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:34.822157 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Going to confirm migration 2 {{(pid=97948) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 03:41:34.872973 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:34.873199 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:34.881690 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a575292f-fbda-488f-884c-dba6e6653b52 for instance 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:41:35.083046 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:35.083202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:35.083434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:35.083609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:35.083754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:35.083874 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1db65baa-7b80-40c8-a478-fcf5221e2e32 req-d97a4b00-031b-4e0f-bf53-e69d489465b5 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state rescued and task_state unrescuing.
May 14 03:41:35.140064 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:35.144736 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:35.328997 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:35.379462 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:35.387337 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Unrescuing
May 14 03:41:35.387337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:35.387337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:35.387337 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:35.433484 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:35.433783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:35.433903 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquired lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:35.434021 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:35.434163 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'info_cache' on Instance uuid 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:35.648626 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:41:35.648626 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730095.6476154, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:35.648626 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Started (Lifecycle Event)
May 14 03:41:35.888665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.686s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:35.889426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:41:35.891163 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.677s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:35.893015 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:35.902118 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:41:35.906657 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Claim successful on node np0000000741
May 14 03:41:36.152247 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:36.157915 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:36.230177 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:36.384164 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:36.399914 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:41:36.400682 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:41:36.401047 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:36.401243 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:36.440688 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:36.465777 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0011670809999486664 future=<Future at 0x79d0b070a0f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:36.465938 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:36.466030 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.9433877430001303 future=<Future at 0x79d0b8296b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:36.466473 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.9429472410001836 future=<Future at 0x79d0b8296b70 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:36.468197 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] Emitting event <LifecycleEvent: 1778730081.4643831, aa344014-0ea0-498a-b2d4-eda732b0189d => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:36.468197 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] VM Stopped (Lifecycle Event)
May 14 03:41:36.487043 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755776b8b15e43bbac70f82cfea689e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce458cafea74d40af089b430f6b92ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:41:36.658918 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 03:41:36.662154 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730096.66182, 18681230-9203-4956-8193-a5cde97a52fa => ua-a575292f-fbda-488f-884c-dba6e6653b52> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:41:36.667310 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully detached device vdb from instance 18681230-9203-4956-8193-a5cde97a52fa from the live domain config.
May 14 03:41:36.668929 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:41:36.669258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:36.669430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:36.670105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:36.670762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a575292f-fbda-488f-884c-dba6e6653b52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:41:36.671058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:36.704138 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52 (non-flash)
May 14 03:41:36.704738 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:41:36.704738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '99')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:36.706094 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52', '98')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:41:36.707568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0221620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'): ({'sdh'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:41:36.709014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:41:36.709329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Flush multipath device 3300000003af2d66b {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:41:36.744214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:36.780816 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:36.792346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:41:36.845073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:41:36.845178 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:41:36.847537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:41:36.870902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:41:36.871256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:41:36.886746 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:36.887281 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'flavor' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:36.894563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:36.902070 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:41:36.943966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.40.100,3260]
May 14 03:41:36.943966 np0000000741 nova-compute[97948]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.40.100,3260] successful.
May 14 03:41:36.943966 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:36.961234 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:36.972996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9de59842-c738-4f2a-a7f6-ceec9213e284 tempest-VolumesActionsTest-329536730 tempest-VolumesActionsTest-329536730-project-member] [instance: aa344014-0ea0-498a-b2d4-eda732b0189d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:36.975975 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [{"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:36.982687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:37.014567 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Successfully created port: e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:41:37.018201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.50.100,3260]
May 14 03:41:37.018201 np0000000741 nova-compute[97948]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-a575292f-fbda-488f-884c-dba6e6653b52, portal: 192.168.50.100,3260] successful.
May 14 03:41:37.018201 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:37.034366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:37.035163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:37.035163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] <== disconnect_volume: return (365ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:37.035163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:41:37.286699 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.410551 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:41:37.428532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.430885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.454118 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.484421 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Releasing lock "refresh_cache-3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:37.484589 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'migration_context' on Instance uuid 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:37.510813 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:37.510998 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:37.570747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.579097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:37.607852 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'flavor' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:37.635388 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:37.636824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:37.640207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:37.641159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:37.641570 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:37.642061 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1f627c58-68c3-4333-9887-52dea5e8f80e req-3e58e59a-d6f2-45f1-8487-c88ed34e421f service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state rescued and task_state unrescuing.
May 14 03:41:37.654712 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Successfully updated port: e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:41:37.720878 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-changed-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:37.720878 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing instance network info cache due to event network-changed-e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:37.720878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:37.720878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:37.720878 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing network info cache for port e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:37.759868 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance destroyed successfully.
May 14 03:41:37.760507 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'numa_topology' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:37.761128 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999842218999902 future=<Future at 0x79d0b0226990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:37.987725 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Object Instance<3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7> lazy-loaded attributes: info_cache,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:37.988931 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:38.014767 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:38.157778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:38.225540 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:38.263361 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Object Instance<eb70716b-7c1c-4efe-aec2-f2780ad6ebff> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:41:38.295058 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00042584399989209487 future=<Future at 0x79d0b8296b70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.842086088000087 future=<Future at 0x79d0b0785670 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.8419842600001175 future=<Future at 0x79d0b0785670 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.35055792299977 future=<Future at 0x79d0b0226990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.350458909999816 future=<Future at 0x79d0b0226990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778730083.4093468, a7a81f92-a39b-4a10-9868-39e256c3bc33 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:38.411668 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] VM Stopped (Lifecycle Event)
May 14 03:41:38.421408 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:41:38.421905 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:41:38.422695 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating image(s)
May 14 03:41:38.422695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:38.423238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:38.423690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:38.425748 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:38.430758 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:38.433086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:38.462763 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:38.528320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.635s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:38.528320 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:41:38.529469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.540s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:38.551951 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:38.552364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:38.552892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:38.553316 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:38.559266 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:41:38.560512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:38.596900 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.618697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7b0116e5-c568-4466-aac5-a72a04557e6c tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.888s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:38.665178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:38.665722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:38.752533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk 1073741824" returned: 0 in 0.087s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:38.752976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:38.753287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:38.775913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.809443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.811516 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.849558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:38.849940 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:41:38.850678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:38.916582 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: a7a81f92-a39b-4a10-9868-39e256c3bc33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:38.918512 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.936128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:38.953539 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:38.953995 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Cannot resize image /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:41:38.954317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:41:38.954510 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Ensure instance console log exists: /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:41:38.954768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:38.954967 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:38.955126 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:38.967848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7966a11-9f0e-45fd-abea-ba2ba4c8b2c7 req-94c68618-1e33-43ec-8a90-ffc0162657c4 service nova] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:38.968340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:38.968508 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:39.039268 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:41:39.039482 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:41:39.040269 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:39.040567 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:39.139864 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:41:39.223365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:39.223602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:39.224147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:39.224147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:39.224295 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:39.227305 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Terminating instance
May 14 03:41:39.546909 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:41:39.591479 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:39.660020 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:39.672002 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:39.672002 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:39.704198 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Successfully created port: 95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:41:39.731551 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:41:39.736398 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:39.736398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:39.736398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:39.736398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:39.736583 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:39.737186 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state rescued and task_state unrescuing.
May 14 03:41:39.737248 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:39.737376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:39.737521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:39.737628 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:39.737761 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:39.737875 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state rescued and task_state unrescuing.
May 14 03:41:39.737981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:39.738265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:39.738265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:39.738622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:39.738622 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:39.738622 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-af7ae22e-f701-4f94-87a3-1a038c333a84 req-03975f37-64b0-44c7-b9a4-49ee4b62ab35 service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received unexpected event network-vif-plugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with vm_state rescued and task_state unrescuing.
May 14 03:41:39.763828 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:39.776060 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for eb70716b-7c1c-4efe-aec2-f2780ad6ebff due to new event <LifecycleEvent: 1778730099.775687, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:41:39.777948 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730099.775687, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:39.777948 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Resumed (Lifecycle Event)
May 14 03:41:39.782204 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-70463775-7251-4039-b9fb-b26cc1836e0b tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:39.789683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:39.824062 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:39.831041 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:39.841702 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:40.046528 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:40.059058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:41:40.114037 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Instance destroyed successfully.
May 14 03:41:40.115737 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lazy-loading 'resources' on Instance uuid 18681230-9203-4956-8193-a5cde97a52fa {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:40.178989 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:40.279626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:40.281960 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:40.374859 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Successfully updated port: 95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:41:40.450367 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-changed-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:40.451519 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Refreshing instance network info cache due to event network-changed-95811650-4547-4ef2-8ab4-71dc290e7785. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:40.451519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] Acquiring lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:40.451519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] Acquired lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:40.451657 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Refreshing network info cache for port 95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:40.551288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:40.551847 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance network_info: |[{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:41:40.553976 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start _get_guest_xml network_info=[{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:40.560004 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:40.561088 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-189719289', uuid='ce825ac9-1ee3-49dc-8a58-38a9447e8784'), owner=OwnerMeta(userid='755776b8b15e43bbac70f82cfea689e2', username='tempest-AttachVolumeShelveTestJSON-1886486107-project-member', projectid='bce458cafea74d40af089b430f6b92ce', projectname='tempest-AttachVolumeShelveTestJSON-1886486107'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730100.5607643) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:40.562353 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:40.563778 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Booting with volume 9a7e47fc-7499-4b1c-87b5-983b35be627f at /dev/vda
May 14 03:41:40.565872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:40.566307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:40.569077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:40.569411 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:40.579877 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYZtmFiHK6KHeFuAXBdI1WJYwmC3qNFD3NJgQvXxS4dGuTlE2O5jKyAEpDeQLiKqZBheLPcFD/jbIXdzA3rtxGl9jDeO1aT+BuENCIc2YdiaqkamwCd3klfiTt7Yw9zQ==',key_name='tempest-keypair-1108094769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:40.579877 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:40.580331 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:40.580880 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_devices' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:40.618463 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:40.622690 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-441132627',display_name='tempest-TestServerVolumeAttachmentScenario-server-441132627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachmentscenario-server-441132627',id=35,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPl9EOdV0X3mB4NSkwmLC9R4opIVZeRz5VJ6pqz6k1hQvt64cSCoQrqByRHI+jqJuNRLfqHk9J0QWpu6YMacVgdIbuaqH5ags9lBxkvJ248jbIDSa3zd/6Oltn5oAkJ/Q==',key_name='tempest-keypair-552183195',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:29Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e302048ab6a04960bceff08f245070e5',ramdisk_id='',reservation_id='r-fo39m50q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-742934758',owner_user_name='tempest-TestServerVolumeAttachmentScenario-742934758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24181722ce14df08872020f0eaece99',uuid=18681230-9203-4956-8193-a5cde97a52fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:41:40.622690 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converting VIF {"id": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "address": "fa:16:3e:02:0d:20", "network": {"id": "8d13e0b0-5409-4588-9c7d-1a55f34c71e2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1574285244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e302048ab6a04960bceff08f245070e5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b72916c-5e", "ovs_interfaceid": "5b72916c-5ea1-4216-b96a-e3f0749869f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:40.622690 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:40.622690 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:41:40.626613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:40.626872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b72916c-5e, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:40.627902 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:40.630242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:40.633391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:41:40.633787 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:40.634859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51ea9d9c-8b24-42fc-a593-2a9b9f2e49aa) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:40.635494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:40.636067 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:40.636449 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:40.641661 np0000000741 nova-compute[97948]: INFO os_vif [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0d:20,bridge_name='br-int',has_traffic_filtering=True,id=5b72916c-5ea1-4216-b96a-e3f0749869f8,network=Network(8d13e0b0-5409-4588-9c7d-1a55f34c71e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b72916c-5e')
May 14 03:41:40.641661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Deleting instance files /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa_del
May 14 03:41:40.641661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Deletion of /opt/stack/data/nova/instances/18681230-9203-4956-8193-a5cde97a52fa_del complete
May 14 03:41:40.666159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:40.721920 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:41:40.722144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:41:40.733006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:41:40.734875 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe3b:ed6e', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe92:8eda', 'fe80::fc16:3eff:fe3a:ff89'] 
May 14 03:41:40.734875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:41:40.734875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:41:40.735287 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:40.735472 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Updating existing volume attachment record: 6c189c21-654b-4476-97e7-c531496a0e7c {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:41:40.786108 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730100.785738, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:40.786257 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Started (Lifecycle Event)
May 14 03:41:40.877076 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:40.954709 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:41.046330 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:41.085520 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <uuid>ce825ac9-1ee3-49dc-8a58-38a9447e8784</uuid>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <name>instance-00000028</name>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-189719289</nova:name>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:40</nova:creationTime>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:user uuid="755776b8b15e43bbac70f82cfea689e2">tempest-AttachVolumeShelveTestJSON-1886486107-project-member</nova:user>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:project uuid="bce458cafea74d40af089b430f6b92ce">tempest-AttachVolumeShelveTestJSON-1886486107</nova:project>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         <nova:port uuid="e5556cca-f97d-4076-99f5-69c144e18564">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="serial">ce825ac9-1ee3-49dc-8a58-38a9447e8784</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="uuid">ce825ac9-1ee3-49dc-8a58-38a9447e8784</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b3:ac:cc"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <target dev="tape5556cca-f9"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/console.log" append="off"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:41.085520 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Preparing to wait for external event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYZtmFiHK6KHeFuAXBdI1WJYwmC3qNFD3NJgQvXxS4dGuTlE2O5jKyAEpDeQLiKqZBheLPcFD/jbIXdzA3rtxGl9jDeO1aT+BuENCIc2YdiaqkamwCd3klfiTt7Yw9zQ==',key_name='tempest-keypair-1108094769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:41:41.088267 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:41.092093 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:41.092093 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:41:41.093612 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.093612 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:41.093612 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:41:41.095437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.095437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b516e226-6c4b-54a8-8ada-8c33e766e244', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:41.096607 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.098059 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:41.100227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.100227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5556cca-f9, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:41.100606 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5556cca-f9, col_values=(('qos', UUID('ea238ead-c5fc-467c-b6a1-705786c26235')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:41.100818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5556cca-f9, col_values=(('external_ids', {'iface-id': 'e5556cca-f97d-4076-99f5-69c144e18564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:ac:cc', 'vm-uuid': 'ce825ac9-1ee3-49dc-8a58-38a9447e8784'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:41.102027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.104411 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:41.111492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:41.112390 np0000000741 nova-compute[97948]: INFO os_vif [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9')
May 14 03:41:41.154239 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Took 1.42 seconds to destroy the instance on the hypervisor.
May 14 03:41:41.154938 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:41:41.157353 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:41:41.157353 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:41:41.157353 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:41.202009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.672s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:41.239378 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:41.255568 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:41.290321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:41.292199 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:41.741346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043ae2ad-d7d5-450a-92bb-20490caaa9d0 req-f252dde0-0933-4e2f-ab13-ad185e13de41 service nova] Releasing lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:41.741796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:41.741957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:41:41.796125 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99970086799999 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:41.833294 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:41.833513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:41.833673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:41.833792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:41.833911 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] No waiting events found dispatching network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:41.834016 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:41.834111 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:41.834288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquiring lock "18681230-9203-4956-8193-a5cde97a52fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:41.834363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:41.835812 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Lock "18681230-9203-4956-8193-a5cde97a52fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:41.835934 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] No waiting events found dispatching network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:41.836044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-unplugged-5b72916c-5ea1-4216-b96a-e3f0749869f8 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:41:41.836142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:41.836249 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing instance network info cache due to event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:41.836395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:41.838998 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Deleted allocation for migration dbed985f-5058-428e-9c18-890a53db0040
May 14 03:41:41.842352 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:41.844743 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:41.881154 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2df4365f-0791-4a5d-bc03-69aa25fc05ed tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Get console output
May 14 03:41:41.951475 np0000000741 nova-compute[97948]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 14 03:41:42.294575 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:42.313354 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:41:42.344496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec09864a-2acc-49cd-b156-93f0fdb4f8e3 tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.522s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:42.346834 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:42.541148 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-64789507-4e3b-4516-b6a4-b9bf63131a03 req-fec5db95-4723-4b85-8540-48fe118b5611 service nova] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Received event network-vif-deleted-5b72916c-5ea1-4216-b96a-e3f0749869f8 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:42.545734 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:42.638748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:42.639042 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:42.639138 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No VIF found with MAC fa:16:3e:b3:ac:cc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:42.639687 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Using config drive
May 14 03:41:42.684431 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Updating instance_info_cache with network_info: [{"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:42.788401 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:42.796743 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Took 1.64 seconds to deallocate network for instance.
May 14 03:41:42.875733 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:41:42.877502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:41:42.878455 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Creating image(s)
May 14 03:41:42.878455 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:41:42.878806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Ensure instance console log exists: /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:41:42.879198 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:42.879432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:42.879629 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:42.937449 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updated VIF entry in instance network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:42.937694 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:43.148510 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:43.186835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-dfd56be9-4f58-4af3-8813-8c72452f8ca5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:43.187192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance network_info: |[{"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:41:43.188081 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Start _get_guest_xml network_info=[{"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'serial': '9a7e47fc-7499-4b1c-87b5-983b35be627f'}, 'boot_index': 0, 'attachment_id': '6c189c21-654b-4476-97e7-c531496a0e7c', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:41:43.191838 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:41:43.193295 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-176658437', uuid='dfd56be9-4f58-4af3-8813-8c72452f8ca5'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730103.1928496) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:41:43.194977 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:41:43.195452 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:41:43.196880 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:41:43.197231 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:41:43.198687 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:41:43.199457 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:41:43.199700 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:41:43.199923 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:41:43.200218 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:41:43.200404 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:41:43.200931 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:41:43.200931 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:41:43.201150 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:41:43.201374 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:41:43.202093 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:41:43.202093 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:41:43.233102 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:41:43.233544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:41:43.233727 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:43.234053 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:43.234218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:41:43.249023 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:43.249474 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:43.249743 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:43.252123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:41:43.252559 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:41:43.252785 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:43.266839 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:43.266839 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:43.274088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:41:43.274088 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:43.282281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f] added
May 14 03:41:43.282281 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:43.282281 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:43.282281 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:43.282281 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:43.282281 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:43.282281 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:43.282952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:43.282952 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:43.283129 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:43.289172 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f] added
May 14 03:41:43.289172 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:41:43.289172 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:43.289172 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:43.289172 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:41:43.289172 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:41:43.289172 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:43.289420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:41:43.289607 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:41:43.289709 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:41:43.304079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:43.304314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:43.308733 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating config drive at /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config
May 14 03:41:43.317234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpewga622w {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:41:43.388709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpewga622w" returned: 0 in 0.071s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:41:43.440298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:43.440580 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:43.440785 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing instance network info cache due to event network-changed-81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:43.441018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquiring lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:43.441377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Acquired lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:43.441377 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Refreshing network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:43.600104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:43.880831 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:43.917889 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:41:43.918338 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:43.920490 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:41:43.944812 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:44.001784 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.251605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.255361 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.261032 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.281528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.283719 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:41:44.290373 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:44.303158 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:44.303158 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:41:44.312147 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:41:44.312147 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.326655 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.336895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.345882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.345882 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.345882 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.345882 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.345882 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:44.347176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.347176 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.347176 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.347176 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.347176 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.355410 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:44.401738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.40.100,3260]
May 14 03:41:44.401738 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.40.100,3260] successful.
May 14 03:41:44.401738 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.409306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.50.100,3260]
May 14 03:41:44.409306 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.50.100,3260] successful.
May 14 03:41:44.409306 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.417584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.425875 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:41:44.430732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:41:44.444188 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.447879 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.448094 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:44.450019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:44.451459 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.452209 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:41:44.452683 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:41:44.453548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:44.454094 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:41:44.462812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('8', '-', '-', 0) found on session 107 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:44.462987 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:44.464286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('7', '-', '-', 0) found on session 106 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:41:44.464286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:41:44.485907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 107 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:44.486197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:44.497182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 106 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:41:44.497182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:41:44.628265 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:44.628989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:44.628989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:44.629945 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:44.632777 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Processing event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:41:44.633118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:44.633335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:44.633552 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:44.634147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:44.634147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] No waiting events found dispatching network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:41:44.634147 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-44111aef-617b-4fc7-a03d-52bfc72e9740 req-c6d93957-5b07-40c4-8500-abb518a50047 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received unexpected event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 for instance with vm_state building and task_state spawning.
May 14 03:41:44.692879 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updated VIF entry in instance network info cache for port 81eb0073-bed0-4c79-86a8-bb56d5861294. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:44.693770 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [{"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:44.716441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:44.912974 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730104.9110682, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:44.912974 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Started (Lifecycle Event)
May 14 03:41:44.913492 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:41:44.920280 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:41:44.922463 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance spawned successfully.
May 14 03:41:44.922805 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:41:44.955058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.651s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:45.026124 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Deleted allocations for instance 18681230-9203-4956-8193-a5cde97a52fa
May 14 03:41:45.203784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ebfd32af-eb2a-4937-b5fe-f911e2efa12a req-77e093aa-f97e-4171-b09d-078e440f6eeb service nova] Releasing lock "refresh_cache-eb70716b-7c1c-4efe-aec2-f2780ad6ebff" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:45.253390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:41:45.417116 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:45.423314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:45.431872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.431983 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.433546 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.433546 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.433546 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.433546 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:41:45.925998 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:41:45.927611 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730105.9265978, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:45.928979 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Paused (Lifecycle Event)
May 14 03:41:45.939205 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Took 7.52 seconds to spawn the instance on the hypervisor.
May 14 03:41:45.939475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:46.037426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0b177d85-2b52-463f-b4d0-e815ad2ded5f tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Lock "18681230-9203-4956-8193-a5cde97a52fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.813s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:46.103028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:46.277417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000cc6bbd16 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:41:46.277733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:41:46.279941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000cc6bbd16', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cc6bbd16'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:41:46.280093 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc6bbd16', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cc6bbd16'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:41:46.324305 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'serial': '9a7e47fc-7499-4b1c-87b5-983b35be627f'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:41:46.325044 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:41:46.325406 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:46.326954 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:41:46.326954 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x79d0b82b8bf0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'serial': '9a7e47fc-7499-4b1c-87b5-983b35be627f'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:41:46.326954 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97948) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 03:41:46.327302 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] opening encrypted volume /dev/dm-0 {{(pid=97948) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 03:41:46.369129 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.luks [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 03:41:46.369368 np0000000741 nova-compute[97948]: INFO os_brick.encryptors.luks [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 14 03:41:46.369679 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] formatting encrypted volume /dev/dm-0 {{(pid=97948) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 03:41:46.431278 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:46.433404 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730106.4328175, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:46.433404 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Resumed (Lifecycle Event)
May 14 03:41:46.453841 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Took 13.35 seconds to build instance.
May 14 03:41:46.938336 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:46.940111 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:41:46.959251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.861s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:47.683240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:48.581292 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-changed-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:41:48.581292 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing instance network info cache due to event network-changed-e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:41:48.581813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:41:48.581813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:41:48.581813 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing network info cache for port e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:41:48.603435 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:49.088309 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:49.595827 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:41:49.832581 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updated VIF entry in instance network info cache for port e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:41:49.833428 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:41:50.336224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c8314e4-fcd6-46a9-af71-d15a9de7506f req-8cc495a7-69be-429c-8d26-f1f892d08350 service nova] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:41:51.119893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:51.279474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:52.244502 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:52.769093 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.008086832000117283 future=<Future at 0x79d0b0226990 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:52.769226 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:52.769395 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.0263688820000425 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:52.769469 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.026277414000106 future=<Future at 0x79d0b0709100 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:53.603681 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:54.040742 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:55.104888 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] opening encrypted volume /dev/dm-0 {{(pid=97948) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 03:41:56.102371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:56.118058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:56.796159 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003585980002753786 future=<Future at 0x79d0b0709100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:56.796319 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:41:56.799560 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778730101.795688, 18681230-9203-4956-8193-a5cde97a52fa => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:41:56.799813 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] VM Stopped (Lifecycle Event)
May 14 03:41:57.306058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 18681230-9203-4956-8193-a5cde97a52fa] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:41:57.806893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176658437',display_name='tempest-TestVolumeBootPattern-server-176658437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-176658437',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-g7c9en3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:40Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dfd56be9-4f58-4af3-8813-8c72452f8ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:41:57.807109 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:57.808268 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:57.808883 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid dfd56be9-4f58-4af3-8813-8c72452f8ca5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:41:58.314030 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] End _get_guest_xml xml=<domain type="qemu">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <uuid>dfd56be9-4f58-4af3-8813-8c72452f8ca5</uuid>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <name>instance-00000029</name>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-176658437</nova:name>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:41:43</nova:creationTime>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         <nova:port uuid="95811650-4547-4ef2-8ab4-71dc290e7785">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <system>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="serial">dfd56be9-4f58-4af3-8813-8c72452f8ca5</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="uuid">dfd56be9-4f58-4af3-8813-8c72452f8ca5</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </system>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <os>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </os>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <features>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </features>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   <devices>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/disk.config"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <alias name="ua-9a7e47fc-7499-4b1c-87b5-983b35be627f"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <serial>9a7e47fc-7499-4b1c-87b5-983b35be627f</serial>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </disk>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:51:3a:5c"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <target dev="tap95811650-45"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </interface>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/console.log" append="off"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </serial>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <video>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </video>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </rng>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:   </devices>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]: </domain>
May 14 03:41:58.314030 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Preparing to wait for external event network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176658437',display_name='tempest-TestVolumeBootPattern-server-176658437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-176658437',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-g7c9en3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:41:40Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dfd56be9-4f58-4af3-8813-8c72452f8ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:41:58.316863 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:41:58.318472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.318472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:58.318472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:41:58.319723 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.319723 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '880b433f-fb29-5c82-bc9e-5bf3ef00a18f', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:58.320106 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.320786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:58.325038 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.325400 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95811650-45, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:58.326081 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95811650-45, col_values=(('qos', UUID('012fff00-c2c2-40da-a3f8-3e095bb53c61')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:58.326323 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95811650-45, col_values=(('external_ids', {'iface-id': '95811650-4547-4ef2-8ab4-71dc290e7785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:3a:5c', 'vm-uuid': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:41:58.327226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.328707 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:41:58.336864 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:58.336864 np0000000741 nova-compute[97948]: INFO os_vif [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45')
May 14 03:41:58.608182 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:59.221046 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:41:59.857845 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:59.857845 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:41:59.857845 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:51:3a:5c, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:41:59.857845 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Using config drive
May 14 03:42:00.362890 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:00.526590 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Creating config drive at /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/disk.config
May 14 03:42:00.529823 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpai3ra424 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:00.584603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpai3ra424" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:00.729855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:00.729999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:01.129121 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.132967 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.169246 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.234097 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:01.237378 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.492266 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.496285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.498653 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.521669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.522402 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:01.823322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:01.823322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:01.833483 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:01.833700 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Claim successful on node np0000000741
May 14 03:42:01.920487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc536757-efe8-4bde-bf94-43603e92c8ff req-06bfc998-d892-4fbc-84ff-7db802696ef2 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:01.920487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc536757-efe8-4bde-bf94-43603e92c8ff req-06bfc998-d892-4fbc-84ff-7db802696ef2 service nova] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:01.920786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc536757-efe8-4bde-bf94-43603e92c8ff req-06bfc998-d892-4fbc-84ff-7db802696ef2 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:01.921449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc536757-efe8-4bde-bf94-43603e92c8ff req-06bfc998-d892-4fbc-84ff-7db802696ef2 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:01.921902 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc536757-efe8-4bde-bf94-43603e92c8ff req-06bfc998-d892-4fbc-84ff-7db802696ef2 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Processing event network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:02.086508 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730122.086007, dfd56be9-4f58-4af3-8813-8c72452f8ca5 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:02.086757 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] VM Started (Lifecycle Event)
May 14 03:42:02.088634 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:02.094013 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:02.095677 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance spawned successfully.
May 14 03:42:02.096036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:02.589928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:02.593630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:02.613260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:02.613392 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:02.613714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:02.614565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:02.614891 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:02.615154 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:03.096435 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:03.100225 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730123.099899, dfd56be9-4f58-4af3-8813-8c72452f8ca5 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:03.100456 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] VM Paused (Lifecycle Event)
May 14 03:42:03.121234 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Took 20.25 seconds to spawn the instance on the hypervisor.
May 14 03:42:03.121412 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:03.337618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:03.404436 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:03.404716 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:03.603890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:03.606204 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730123.6059318, dfd56be9-4f58-4af3-8813-8c72452f8ca5 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:03.606322 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] VM Resumed (Lifecycle Event)
May 14 03:42:03.607014 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:03.631305 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Took 30.48 seconds to build instance.
May 14 03:42:03.907664 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:03.990673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:03.990673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:03.991242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:03.991242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:03.991242 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] No waiting events found dispatching network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:03.991434 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-c98a8695-999b-4054-8345-2cd4c45b65ce req-577f1aaa-587e-44a6-8fe8-403706c42d75 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received unexpected event network-vif-plugged-95811650-4547-4ef2-8ab4-71dc290e7785 for instance with vm_state active and task_state None.
May 14 03:42:04.112020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:04.114126 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:04.132815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.993s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:04.416101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.592s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:04.416101 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:04.473629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:04.926251 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:04.927220 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:04.927549 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:04.928102 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:05.030816 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b9b5ad65f04a5c92c310335f9d4115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07892e98c064e25b4a6a9069fa574e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:05.386427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:05.386717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:05.387080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:05.387080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:05.387168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:05.390499 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Terminating instance
May 14 03:42:05.427520 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:05.762853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:05.763055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:05.763254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:05.763402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:05.763532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:05.769286 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Terminating instance
May 14 03:42:05.896000 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:05.924569 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:05.928613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:05.947291 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:05.951986 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.037952 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:06.037952 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:06.123172 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.130280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.208346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.217223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.242850 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999645425999915 future=<Future at 0x79d0b0483b90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:06.243215 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999032305999663 future=<Future at 0x79d0b0483b90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:06.243342 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99889601399991 future=<Future at 0x79d0b0483b90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:06.246161 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Instance destroyed successfully.
May 14 03:42:06.247713 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'resources' on Instance uuid 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:06.275563 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:06.312481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.315553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.337747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.340056 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.374675 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.375834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.407895 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Successfully created port: 993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:06.544492 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:06.627348 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999589122000089 future=<Future at 0x79d0b00a9be0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:06.632154 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Instance destroyed successfully.
May 14 03:42:06.632495 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid dfd56be9-4f58-4af3-8813-8c72452f8ca5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:06.689509 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.751740 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1795803912',display_name='tempest-ServerActionsTestOtherA-server-1795803912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1795803912',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:33Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-e2kfxjgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:06.752039 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "075309ef-fec3-45a6-adad-f9090f09ef1c", "address": "fa:16:3e:92:8e:da", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap075309ef-fe", "ovs_interfaceid": "075309ef-fec3-45a6-adad-f9090f09ef1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:06.752656 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:06.753068 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:06.754662 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.754925 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap075309ef-fe, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:06.756914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.757973 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:06.764084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.768066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.769011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cc08240-5c92-4432-87db-9240a727bd9d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:06.770448 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.770679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:06.777329 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:06.781585 np0000000741 nova-compute[97948]: INFO os_vif [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:da,bridge_name='br-int',has_traffic_filtering=True,id=075309ef-fec3-45a6-adad-f9090f09ef1c,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075309ef-fe')
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e09e7940-a866-4f94-87b2-96b23f9ea816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:42:06.786762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816 (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:06.820875 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '107')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:42:06.820875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '104')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:06.822189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816', '105')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:06.823075 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b859d260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:42:06.823075 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:42:06.823299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Flush multipath device 330000000180e3ffd {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:42:06.880584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:06.939370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:06.940803 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:06.941778 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:06.942240 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Creating image(s)
May 14 03:42:06.945684 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:06.945902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:06.946473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:06.947331 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:06.956303 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:06.957944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:06.993463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:42:06.993856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:42:06.998722 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:42:07.015313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:42:07.015959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:42:07.035878 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.069502 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260]
May 14 03:42:07.069502 np0000000741 nova-compute[97948]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.40.100,3260] successful.
May 14 03:42:07.069502 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.083592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.126s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:07.084237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:07.084745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:07.085279 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:07.091587 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:07.092242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:07.094089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.137472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.141732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176658437',display_name='tempest-TestVolumeBootPattern-server-176658437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-176658437',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:03Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-g7c9en3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:03Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dfd56be9-4f58-4af3-8813-8c72452f8ca5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:07.141732 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "95811650-4547-4ef2-8ab4-71dc290e7785", "address": "fa:16:3e:51:3a:5c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95811650-45", "ovs_interfaceid": "95811650-4547-4ef2-8ab4-71dc290e7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:07.142659 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:07.144008 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:07.148059 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.148059 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95811650-45, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:07.149483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.150428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:07.151154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.153077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.153346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=012fff00-c2c2-40da-a3f8-3e095bb53c61) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:07.154541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.155280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:07.155605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:07.159928 np0000000741 nova-compute[97948]: INFO os_vif [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=95811650-4547-4ef2-8ab4-71dc290e7785,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95811650-45')
May 14 03:42:07.181733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260]
May 14 03:42:07.181733 np0000000741 nova-compute[97948]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-e09e7940-a866-4f94-87b2-96b23f9ea816, portal: 192.168.50.100,3260] successful.
May 14 03:42:07.181733 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.204290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.204290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:07.204290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] <== disconnect_volume: return (417ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:07.204290 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:42:07.204290 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Deleting instance files /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7_del
May 14 03:42:07.205299 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Deletion of /opt/stack/data/nova/instances/3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7_del complete
May 14 03:42:07.216224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:07.216766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:07.241337 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'serial': '9a7e47fc-7499-4b1c-87b5-983b35be627f'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:42:07.244154 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:42:07.244154 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:42:07.247768 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:42:07.249675 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x79d0b04417f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'dfd56be9-4f58-4af3-8813-8c72452f8ca5', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'serial': '9a7e47fc-7499-4b1c-87b5-983b35be627f'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:42:07.249836 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] closing encrypted volume /dev/dm-4 {{(pid=97948) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 14 03:42:07.282493 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:42:07.283088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:07.283561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:07.285935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:07.285935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a7e47fc-7499-4b1c-87b5-983b35be627f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:42:07.285935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:42:07.296592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk 1073741824" returned: 0 in 0.080s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:07.297212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:07.297582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:07.330276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:07.330276 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:07.330276 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:07.330276 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:07.330276 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:07.330705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:07.330705 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:07.330705 np0000000741 nova-compute[97948]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:07.330705 np0000000741 nova-compute[97948]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f (non-flash)
May 14 03:42:07.330705 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:07.331063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '107')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:42:07.331241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '106')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:07.332312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f', '107')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:07.333199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b859d300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'): ({'sdb'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:42:07.333753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:42:07.334146 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000cc6bbd16 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:42:07.369681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:07.410595 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:07.411176 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:42:07.411541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:07.432069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:07.492921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:42:07.493271 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:42:07.494705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:42:07.512396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:42:07.512871 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:42:07.526882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.537613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:07.537798 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Cannot resize image /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:42:07.538193 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:42:07.538401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Ensure instance console log exists: /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:07.538964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:07.538964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:07.539096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:07.555568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:07.572172 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.40.100,3260]
May 14 03:42:07.572172 np0000000741 nova-compute[97948]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.40.100,3260] successful.
May 14 03:42:07.572172 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.591010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.604433 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.635320 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.50.100,3260]
May 14 03:42:07.635320 np0000000741 nova-compute[97948]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-9a7e47fc-7499-4b1c-87b5-983b35be627f, portal: 192.168.50.100,3260] successful.
May 14 03:42:07.635320 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.650607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:07.654959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:07.654959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (368ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:07.654959 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:42:07.654959 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Deleting instance files /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5_del
May 14 03:42:07.654959 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Deletion of /opt/stack/data/nova/instances/dfd56be9-4f58-4af3-8813-8c72452f8ca5_del complete
May 14 03:42:07.693039 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:07.693444 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:07.693444 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:07.693681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:07.693828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:07.694662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3f23fe6a-915f-4f0d-8094-6920d7ec0ee8 req-0128920a-669e-4a3d-b4db-b3a37820f4cf service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:07.718041 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Took 1.82 seconds to destroy the instance on the hypervisor.
May 14 03:42:07.718937 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:07.719211 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:07.719322 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:07.720104 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:07.762533 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:07.762533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:07.762533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:07.764458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:07.764458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] No waiting events found dispatching network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:07.764458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ea2029c7-b4bd-4837-b091-2a311092aed9 req-9a20903b-c14e-4c70-891b-883123d6b21b service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:07.939309 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:08.170519 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Took 1.89 seconds to destroy the instance on the hypervisor.
May 14 03:42:08.172355 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:08.172609 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:08.172741 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:08.173006 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:08.268918 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Successfully updated port: 993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:08.305427 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:08.346101 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-changed-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:08.349442 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Refreshing instance network info cache due to event network-changed-993f62e1-1c92-4ac3-9f54-b5a02743d55b. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:08.349622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] Acquiring lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:08.349764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] Acquired lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:08.349900 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Refreshing network info cache for port 993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:08.612076 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:08.656484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:08.657082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:08.657082 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Attaching volume c795dbe7-68a1-4fcb-aee7-99455c35bb7b to /dev/vdb
May 14 03:42:08.705084 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:08.718608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:42:08.745083 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:08.775036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:08.799753 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:42:08.799753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:42:08.808952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:42:08.810783 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe93:b21', 'fe80::14bf:fff:fee9:5c83', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe3b:ed6e', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48'] 
May 14 03:42:08.811027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:42:08.811149 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:42:08.811677 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:08.812033 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating existing volume attachment record: fe17d925-5b73-47b9-9ff1-69dec5638078 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:42:08.852422 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:08.931814 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:09.082249 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:09.095497 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:09.160221 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:09.375036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:42:09.376119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:09.376119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:09.376612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:09.376935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:42:09.393025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:09.393874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:09.394537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:09.396831 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:09.397211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:09.397408 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:09.409423 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:09.409423 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:09.413844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:09.413844 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:09.430074 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b] added
May 14 03:42:09.430074 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:09.430074 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:09.430074 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:09.430074 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:09.430074 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:09.430074 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:09.430333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:09.430377 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:09.430546 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:09.432753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b] added
May 14 03:42:09.432753 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:09.432753 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:09.432753 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:09.432753 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:09.432753 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:09.432753 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:09.433025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:09.433099 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:09.433281 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:09.586066 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Took 1.87 seconds to deallocate network for instance.
May 14 03:42:09.598548 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c365eaa-9e7c-450a-acfc-64499398af4f req-22f495a2-0427-4266-8267-80d659db82e1 service nova] Releasing lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:09.598719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquired lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:09.598895 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:09.662492 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Took 1.49 seconds to deallocate network for instance.
May 14 03:42:09.771912 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:09.775987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] Acquiring lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:09.776182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:09.776336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:09.776463 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] No waiting events found dispatching network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:09.776578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b4adac6-bfe6-4698-983c-9994df3622a3 req-e58c7b16-a5c4-49fb-b97a-f4aa1a71a4b2 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-unplugged-075309ef-fec3-45a6-adad-f9090f09ef1c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:09.840678 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:09.841426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] Acquiring lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:09.841426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:09.841479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:09.842413 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] No waiting events found dispatching network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:09.842413 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-unplugged-95811650-4547-4ef2-8ab4-71dc290e7785 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:09.842413 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d4b6a4e-57c8-4a14-b80d-27e5e7358769 req-2fd2eb4c-c2cb-40b2-9923-a736702b77b4 service nova] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Received event network-vif-deleted-075309ef-fec3-45a6-adad-f9090f09ef1c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:10.155731 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Took 0.57 seconds to detach 1 volumes for instance.
May 14 03:42:10.159712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Deleting volume: e09e7940-a866-4f94-87b2-96b23f9ea816 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:42:10.184593 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:10.240304 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Took 0.58 seconds to detach 1 volumes for instance.
May 14 03:42:10.350237 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:10.415742 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-338563ac-f77e-4dbd-b804-4f1bab5ddf7b req-8a08d390-f3ee-407c-bd82-9761def2f71b service nova] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Received event network-vif-deleted-95811650-4547-4ef2-8ab4-71dc290e7785 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:10.431035 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:10.433752 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:10.441621 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:10.441621 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:10.446841 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:10.446841 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.454437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.460091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.467981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.467981 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.467981 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:10.468207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.468207 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.468207 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:10.476093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.476093 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.476093 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:10.476248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.476248 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.476248 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:10.500848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.40.100,3260]
May 14 03:42:10.500848 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.40.100,3260] successful.
May 14 03:42:10.500848 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.515173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.518699 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating instance_info_cache with network_info: [{"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:10.520998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.50.100,3260]
May 14 03:42:10.520998 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.50.100,3260] successful.
May 14 03:42:10.520998 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.530082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.530082 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.530082 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.530082 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.530082 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:10.530317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.530317 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.530317 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.530317 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.530317 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:10.530520 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:10.530705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:10.531487 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('7', '-', '-', 0) found on session 108 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:10.531740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:10.536981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:10.547447 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 108 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:10.548119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:10.552624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.552624 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.552624 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.552624 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.552624 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:10.552844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.552844 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:10.552844 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.552844 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:10.552844 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:10.553054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:10.553168 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:10.553829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('8', '-', '-', 0) found on session 109 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:10.553927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:10.568734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 109 and hctl ['8', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:10.712908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:10.713092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:10.715287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:10.746358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:10.746469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:10.787628 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Deleted allocations for instance 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7
May 14 03:42:11.020967 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Releasing lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:11.021213 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance network_info: |[{"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:11.023757 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Start _get_guest_xml network_info=[{"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:11.027016 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:11.028411 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-112623874', uuid='b4494ccc-44c6-427e-b6fb-8223b02e60de'), owner=OwnerMeta(userid='01b9b5ad65f04a5c92c310335f9d4115', username='tempest-VolumesExtendAttachedTest-32155928-project-member', projectid='e07892e98c064e25b4a6a9069fa574e7', projectname='tempest-VolumesExtendAttachedTest-32155928'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730131.028055) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:11.029462 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:11.029872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:11.030903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:11.031148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:11.032277 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:11.032710 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:11.032972 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:11.033052 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:11.033187 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:11.033267 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:11.033351 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:11.033497 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:11.033587 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:11.033700 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:11.033796 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:11.033903 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:11.046472 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-112623874',display_name='tempest-VolumesExtendAttachedTest-instance-112623874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesextendattachedtest-instance-112623874',id=42,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6PjmoBUPYcyemqkF9mlaAMeTKV7+u5gcNGJf3nPne1yQE4Dd+7vi+z274QfcqJb6U5MRNGKQXmDIRXeNBzydkh+AxJAUSUFXgEtZgolG4MNwdLIPYAYDdCczGSYJt7Q==',key_name='tempest-keypair-1132758243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e07892e98c064e25b4a6a9069fa574e7',ramdisk_id='',reservation_id='r-ki4fx1ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-32155928',owner_user_name='tempest-VolumesExtendAttachedTest-32155928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b9b5ad65f04a5c92c310335f9d4115',uuid=b4494ccc-44c6-427e-b6fb-8223b02e60de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:11.048089 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converting VIF {"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:11.048089 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:11.048506 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lazy-loading 'pci_devices' on Instance uuid b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:11.153229 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:11.153498 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:11.551352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <uuid>b4494ccc-44c6-427e-b6fb-8223b02e60de</uuid>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <name>instance-0000002a</name>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-112623874</nova:name>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:11</nova:creationTime>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:user uuid="01b9b5ad65f04a5c92c310335f9d4115">tempest-VolumesExtendAttachedTest-32155928-project-member</nova:user>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:project uuid="e07892e98c064e25b4a6a9069fa574e7">tempest-VolumesExtendAttachedTest-32155928</nova:project>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         <nova:port uuid="993f62e1-1c92-4ac3-9f54-b5a02743d55b">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="serial">b4494ccc-44c6-427e-b6fb-8223b02e60de</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="uuid">b4494ccc-44c6-427e-b6fb-8223b02e60de</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.config"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:12:87:b4"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <target dev="tap993f62e1-1c"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/console.log" append="off"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:11.551352 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Preparing to wait for external event network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-112623874',display_name='tempest-VolumesExtendAttachedTest-instance-112623874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesextendattachedtest-instance-112623874',id=42,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6PjmoBUPYcyemqkF9mlaAMeTKV7+u5gcNGJf3nPne1yQE4Dd+7vi+z274QfcqJb6U5MRNGKQXmDIRXeNBzydkh+AxJAUSUFXgEtZgolG4MNwdLIPYAYDdCczGSYJt7Q==',key_name='tempest-keypair-1132758243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e07892e98c064e25b4a6a9069fa574e7',ramdisk_id='',reservation_id='r-ki4fx1ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-32155928',owner_user_name='tempest-VolumesExtendAttachedTest-32155928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b9b5ad65f04a5c92c310335f9d4115',uuid=b4494ccc-44c6-427e-b6fb-8223b02e60de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converting VIF {"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:11.555352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:11.556362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.556504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8db19b5e-d625-546d-bc8e-2e9659a73429', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:11.557477 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.558073 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:11.558705 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.560454 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.560619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap993f62e1-1c, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:11.560955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap993f62e1-1c, col_values=(('qos', UUID('fbf38c05-96cc-4ebd-9f4b-d418b292228c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:11.561102 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap993f62e1-1c, col_values=(('external_ids', {'iface-id': '993f62e1-1c92-4ac3-9f54-b5a02743d55b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:87:b4', 'vm-uuid': 'b4494ccc-44c6-427e-b6fb-8223b02e60de'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:11.561763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.563190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:11.568762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:11.569771 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 109 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:11.570661 np0000000741 nova-compute[97948]: INFO os_vif [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c')
May 14 03:42:11.570865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:11.656745 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:11.796624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-359daffa-d2f7-4ce2-b8ae-350076033d6f tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.410s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:11.831660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:11.831905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:12.163159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.417s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:12.211801 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance dfd56be9-4f58-4af3-8813-8c72452f8ca5
May 14 03:42:12.334079 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:12.413456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found WWN 33000000070007781 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:42:12.413744 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:12.413880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000070007781', 'path': '/dev/dm-0', 'multipath_id': '33000000070007781'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:12.413998 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000070007781', 'path': '/dev/dm-0', 'multipath_id': '33000000070007781'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:42:12.416415 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:12.896755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:12.897848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:12.902919 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:12.902919 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Claim successful on node np0000000741
May 14 03:42:12.919440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Attempting to attach volume c795dbe7-68a1-4fcb-aee7-99455c35bb7b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:42:12.920572 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:   <alias name="ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b"/>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:   <serial>c795dbe7-68a1-4fcb-aee7-99455c35bb7b</serial>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]: </disk>
May 14 03:42:12.920572 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:42:13.086739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:13.086881 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:13.086983 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No VIF found with MAC fa:16:3e:12:87:b4, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:13.087992 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Using config drive
May 14 03:42:13.219207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-de84e20d-2ef4-468c-bce8-82ab7a667da7 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dfd56be9-4f58-4af3-8813-8c72452f8ca5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.456s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:13.595245 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:13.611600 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:13.748917 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Creating config drive at /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.config
May 14 03:42:13.759143 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqkl3ak2t {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:13.835012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqkl3ak2t" returned: 0 in 0.075s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:14.141161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:14.141706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:14.141760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:14.141983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:14.142226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:14.145338 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Terminating instance
May 14 03:42:14.311159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.344995 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.440164 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:14.440164 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:14.459108 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.539723 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc3d98d8-d2b5-43e3-ba55-473d55ff053f req-c3dd5875-adba-4855-9224-7e6b381259b1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:14.539723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc3d98d8-d2b5-43e3-ba55-473d55ff053f req-c3dd5875-adba-4855-9224-7e6b381259b1 service nova] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:14.540177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc3d98d8-d2b5-43e3-ba55-473d55ff053f req-c3dd5875-adba-4855-9224-7e6b381259b1 service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:14.540748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc3d98d8-d2b5-43e3-ba55-473d55ff053f req-c3dd5875-adba-4855-9224-7e6b381259b1 service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:14.540748 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc3d98d8-d2b5-43e3-ba55-473d55ff053f req-c3dd5875-adba-4855-9224-7e6b381259b1 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Processing event network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:14.590480 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:14.590617 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:14.590766 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:14.590893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:3b:ed:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:14.649372 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:14.673792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.682780 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.694402 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.702603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.707141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.712792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.737836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.746479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.898714 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.911634 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:14.911812 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:14.912073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:14.912206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:14.912345 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] No waiting events found dispatching network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:14.912454 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-76dc3283-5513-4961-9cd6-7e6561103ad7 req-7e10d771-b491-4d5f-ad4c-7817f76169b9 service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:14.925829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.930073 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:14.945204 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:15.002856 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999601274999804 future=<Future at 0x79d0b0480260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:15.010505 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Instance destroyed successfully.
May 14 03:42:15.011053 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lazy-loading 'resources' on Instance uuid d2a0afdf-49df-42a9-b430-11871f7a16ef {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:15.432255 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:15.432604 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730135.432079, b4494ccc-44c6-427e-b6fb-8223b02e60de => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:15.432604 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] VM Started (Lifecycle Event)
May 14 03:42:15.434838 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:15.437843 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance spawned successfully.
May 14 03:42:15.439514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:15.459385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.562s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:15.460359 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:15.516684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1793276451',display_name='tempest-ServerActionsTestOtherA-server-1793276451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serveractionstestothera-server-1793276451',id=24,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZNSxyIiixLsesIgsuMg6kECFlVAEFqdH7QMzdyr4HqAJS0IHA7BdJuDR0oAfNlJicKbGrkEKkPpI9HS4EUz5fvE2GVbIpiz+6ITomJhsUm8fat+AxjmYN+Jqe4vpNoQ==',key_name='tempest-keypair-1141736072',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:37:40Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a8404c7d33468cab5b1fb42b63d221',ramdisk_id='',reservation_id='r-r9cb3nxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-882285516',owner_user_name='tempest-ServerActionsTestOtherA-882285516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71a50ef37e66489cbf8dc1dde0950769',uuid=d2a0afdf-49df-42a9-b430-11871f7a16ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:15.516978 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converting VIF {"id": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "address": "fa:16:3e:93:0b:21", "network": {"id": "73c6d4d0-08a8-464b-9a18-f263ba57a188", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-97994626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "37a8404c7d33468cab5b1fb42b63d221", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42b1eb4-3b", "ovs_interfaceid": "d42b1eb4-3b46-484f-8eb9-976dce88b189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:15.519607 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:15.519973 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:15.521436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:15.521569 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd42b1eb4-3b, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:15.523599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:15.524452 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:15.524843 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:15.524981 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09e4478f-dddb-460c-a0fd-986dc1749832) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:15.525749 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:15.525957 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:15.526282 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:15.527966 np0000000741 nova-compute[97948]: INFO os_vif [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0b:21,bridge_name='br-int',has_traffic_filtering=True,id=d42b1eb4-3b46-484f-8eb9-976dce88b189,network=Network(73c6d4d0-08a8-464b-9a18-f263ba57a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42b1eb4-3b')
May 14 03:42:15.528247 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Deleting instance files /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef_del
May 14 03:42:15.529110 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Deletion of /opt/stack/data/nova/instances/d2a0afdf-49df-42a9-b430-11871f7a16ef_del complete
May 14 03:42:15.935666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:15.939019 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:15.947952 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.948073 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.948807 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.948807 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.949220 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.949521 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:15.967246 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:15.967500 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:15.967843 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:15.968188 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:16.038245 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:42:16.039386 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:16.039603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:16.039749 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:16.040042 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:16.099945 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33d5d5f4d4d84196956203afe36f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881e23fb403045d89cc278cce41eb2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:16.135067 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:16.154744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6fdd49f-8c71-4859-99e5-2601e957fe93 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.498s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:16.443493 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:16.443960 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730136.4435716, b4494ccc-44c6-427e-b6fb-8223b02e60de => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:16.443960 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] VM Paused (Lifecycle Event)
May 14 03:42:16.460023 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Took 9.52 seconds to spawn the instance on the hypervisor.
May 14 03:42:16.460251 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:16.473517 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:16.616999 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:16.617319 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:16.617480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:16.617632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:16.617710 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] No waiting events found dispatching network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:16.617799 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dae5c344-a743-48af-bc18-d69c85e92711 req-189b127f-9d71-4d79-8746-ad411716b53b service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received unexpected event network-vif-plugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b for instance with vm_state active and task_state None.
May 14 03:42:16.698068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:16.698294 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:16.831384 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Successfully created port: bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:16.948091 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:16.952680 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730136.950621, b4494ccc-44c6-427e-b6fb-8223b02e60de => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:16.952680 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] VM Resumed (Lifecycle Event)
May 14 03:42:16.971759 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Took 15.23 seconds to build instance.
May 14 03:42:16.986373 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:16.992782 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:17.007542 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:17.008679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] Acquiring lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:17.008840 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:17.009067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:17.009489 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] No waiting events found dispatching network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:17.009607 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-unplugged-d42b1eb4-3b46-484f-8eb9-976dce88b189 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:17.009783 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Received event network-vif-deleted-d42b1eb4-3b46-484f-8eb9-976dce88b189 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:17.009830 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Neutron deleted interface d42b1eb4-3b46-484f-8eb9-976dce88b189; detaching it from the instance and deleting it from the info cache
May 14 03:42:17.010017 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:17.201730 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Detaching volume c795dbe7-68a1-4fcb-aee7-99455c35bb7b
May 14 03:42:17.261157 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Attempting to driver detach volume c795dbe7-68a1-4fcb-aee7-99455c35bb7b from mountpoint /dev/vdb
May 14 03:42:17.273501 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:42:17.275453 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:42:17.276202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Attempting to detach device vdb from instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:42:17.276202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <alias name="ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b"/>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <serial>c795dbe7-68a1-4fcb-aee7-99455c35bb7b</serial>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]: </disk>
May 14 03:42:17.276202 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:42:17.290832 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 from the persistent domain config.
May 14 03:42:17.291090 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] (1/8): Attempting to detach device vdb with device alias ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b from instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:42:17.291385 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <alias name="ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b"/>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <serial>c795dbe7-68a1-4fcb-aee7-99455c35bb7b</serial>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]: </disk>
May 14 03:42:17.291385 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:42:17.454438 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:17.459605 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:17.475863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.745s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:17.490574 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Booting with volume fcc626a8-7b3a-4876-81c5-83430f2b8fd3 at /dev/vda
May 14 03:42:17.498403 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Took 1.46 seconds to deallocate network for instance.
May 14 03:42:17.517142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a6db779d-9c19-4fe8-831e-1e9907f82ce9 req-43604b36-da7a-4255-9897-a9f9d6010f0d service nova] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Detach interface failed, port_id=d42b1eb4-3b46-484f-8eb9-976dce88b189, reason: Instance d2a0afdf-49df-42a9-b430-11871f7a16ef could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:42:17.544811 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Successfully updated port: bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:17.550626 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:17.567568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:42:17.607746 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:17.649818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:42:17.650130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:42:17.660511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:42:17.661797 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:fe3b:ed6e', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:fe3a:ff89', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe12:87b4', 'fe80::68d4:c9ff:fefa:f980'] 
May 14 03:42:17.661937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:42:17.662119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:42:17.662291 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:17.662491 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating existing volume attachment record: 1e605144-f1ac-4549-9c75-05843e4d272b {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:42:17.935360 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b for instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:42:17.968461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730137.9680498, 4307e5f7-29b9-4320-8fa8-454bf5e15df6 => ua-c795dbe7-68a1-4fcb-aee7-99455c35bb7b> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:42:17.971973 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 from the live domain config.
May 14 03:42:17.973261 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:42:17.973668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:17.973808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:17.974355 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:17.974545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:42:17.974701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b (non-flash)
May 14 03:42:18.010211 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:18.010541 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', '109')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:42:18.010541 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', '108')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:18.011312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b', '109')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:18.012035 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b077f060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:42:18.012227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:42:18.012477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flush multipath device 33000000070007781 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:42:18.016499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:18.016821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:18.045478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:18.047462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:18.047668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:18.047962 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:18.077162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:18.077346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:18.096915 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:18.144392 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:42:18.145704 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:42:18.148117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:42:18.162188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:42:18.162523 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:42:18.177165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.221794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.40.100,3260]
May 14 03:42:18.221794 np0000000741 nova-compute[97948]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.40.100,3260] successful.
May 14 03:42:18.221794 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.242219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.258476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.292958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.50.100,3260]
May 14 03:42:18.292958 np0000000741 nova-compute[97948]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-c795dbe7-68a1-4fcb-aee7-99455c35bb7b, portal: 192.168.50.100,3260] successful.
May 14 03:42:18.292958 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.308498 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:18.308727 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:18.308838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== disconnect_volume: return (335ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:18.308968 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:42:18.502335 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:18.502908 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:18.583697 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Detaching volume 37550fb5-203a-4ec4-873a-c12ccbe53e60
May 14 03:42:18.616663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:18.641906 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:18.649264 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Attempting to driver detach volume 37550fb5-203a-4ec4-873a-c12ccbe53e60 from mountpoint /dev/vdb
May 14 03:42:18.658802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Found disk vdb by alias ua-37550fb5-203a-4ec4-873a-c12ccbe53e60 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:42:18.660578 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Found disk vdb by alias ua-37550fb5-203a-4ec4-873a-c12ccbe53e60 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:42:18.660840 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Attempting to detach device vdb from instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:42:18.661055 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <alias name="ua-37550fb5-203a-4ec4-873a-c12ccbe53e60"/>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <serial>37550fb5-203a-4ec4-873a-c12ccbe53e60</serial>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]: </disk>
May 14 03:42:18.661055 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:42:18.668854 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully detached device vdb from instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff from the persistent domain config.
May 14 03:42:18.669013 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] (1/8): Attempting to detach device vdb with device alias ua-37550fb5-203a-4ec4-873a-c12ccbe53e60 from instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:42:18.669322 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <alias name="ua-37550fb5-203a-4ec4-873a-c12ccbe53e60"/>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <serial>37550fb5-203a-4ec4-873a-c12ccbe53e60</serial>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]: </disk>
May 14 03:42:18.669322 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:42:18.777933 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:18.781675 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:18.785429 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:18.785757 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:18.845956 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:18.870678 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:19.006841 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:19.047709 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:19.084308 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:19.086110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing instance network info cache due to event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:19.086300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:19.333596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730139.332697, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => ua-37550fb5-203a-4ec4-873a-c12ccbe53e60> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:42:19.335900 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-37550fb5-203a-4ec4-873a-c12ccbe53e60 for instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:42:19.338347 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully detached device vdb from instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff from the live domain config.
May 14 03:42:19.340408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:42:19.340748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:19.340905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:19.341464 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:19.341764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37550fb5-203a-4ec4-873a-c12ccbe53e60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:42:19.341914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:42:19.365118 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:19.365118 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:19.365118 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:19.365279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:19.365279 np0000000741 nova-compute[97948]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60 (non-flash)
May 14 03:42:19.365279 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:19.365377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:42:19.365457 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '101')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:19.366179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60', '100')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:42:19.366706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b077c9a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:42:19.366886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Removing multipathed devices sdk, sdj {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:42:19.367124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Flush multipath device 330000000b9fbdba8 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:42:19.403725 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:19.451605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:42:19.502221 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:42:19.502496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:42:19.503160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:42:19.517353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:42:19.517567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:42:19.519611 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.503s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:19.530526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.550120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:19.553262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance network_info: |[{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:19.554017 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:19.554675 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:19.565597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.40.100,3260]
May 14 03:42:19.565597 np0000000741 nova-compute[97948]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.40.100,3260] successful.
May 14 03:42:19.565597 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.571828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:19.573093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:19.579101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.592085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.615334 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Deleted allocations for instance d2a0afdf-49df-42a9-b430-11871f7a16ef
May 14 03:42:19.631044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.50.100,3260]
May 14 03:42:19.631044 np0000000741 nova-compute[97948]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-37550fb5-203a-4ec4-873a-c12ccbe53e60, portal: 192.168.50.100,3260] successful.
May 14 03:42:19.631044 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.644415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.644909 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:19.645109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] <== disconnect_volume: return (304ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:19.645379 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:42:19.781394 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:19.784513 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:19.785117 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating image(s)
May 14 03:42:19.786214 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:42:19.786422 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Ensure instance console log exists: /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:19.786740 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:19.786971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:19.787142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:19.787835 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start _get_guest_xml network_info=[{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '41fa8526-521c-46aa-af0a-434ff652136e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'serial': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3'}, 'boot_index': 0, 'attachment_id': '1e605144-f1ac-4549-9c75-05843e4d272b', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:19.788660 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:19.789077 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:19.790611 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:19.792088 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-529657334', uuid='41fa8526-521c-46aa-af0a-434ff652136e'), owner=OwnerMeta(userid='33d5d5f4d4d84196956203afe36f6d37', username='tempest-TestShelveInstance-1690582218-project-member', projectid='881e23fb403045d89cc278cce41eb2a5', projectname='tempest-TestShelveInstance-1690582218'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730139.7916794) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:19.793385 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:19.793820 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:19.794943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:19.795188 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:19.796297 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:19.798438 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:19.801659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:19.814785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:42:19.815265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:19.815581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:19.816052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:19.816365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:42:19.829883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:19.830690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:19.831323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:19.831567 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:19.832053 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:19.832272 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:19.843946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:19.843946 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.844621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:19.844621 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.861268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3] added
May 14 03:42:19.861268 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:19.861268 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:19.861268 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:19.861268 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:19.861268 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:19.861268 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3] added
May 14 03:42:19.862435 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:19.862435 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:19.862435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:19.862753 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:19.862753 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:19.862951 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:19.863098 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:19.876630 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ea19c8ec-7bf5-493e-88c4-a6cfbf4f6c69 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.178s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:20.077683 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:20.079201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:20.079398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:20.079608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:20.079813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:20.079933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:20.084986 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Terminating instance
May 14 03:42:20.087475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:20.191568 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'flavor' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:20.403602 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:20.526216 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:20.544161 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updated VIF entry in instance network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:20.544446 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:20.591828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:20.616084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:20.625623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e6bf8c87-556f-4505-8c78-5b27ab23d23e tempest-ServerActionsTestOtherA-882285516 tempest-ServerActionsTestOtherA-882285516-project-member] Lock "d2a0afdf-49df-42a9-b430-11871f7a16ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.484s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:20.643044 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:20.647828 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:20.669471 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:20.670013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:20.674480 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:20.674718 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Claim successful on node np0000000741
May 14 03:42:20.677205 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:20.859289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:20.859918 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:20.860303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:20.860606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:20.860606 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] No waiting events found dispatching network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:20.860850 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a22475bf-9f44-46f3-9181-b74be8ce2c96 req-2bb27eb9-a6ef-40b9-884e-d36c32953704 service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:20.863487 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:20.863909 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:20.881529 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:20.881529 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:20.889322 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:20.889322 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.900173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.907099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.917974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:42:20.917974 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:20.918132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:42:20.918132 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:20.918302 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:42:20.918302 np0000000741 nova-compute[97948]: 
May 14 03:42:20.920907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 03:42:20.920907 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:20.921110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 03:42:20.921110 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:20.921253 np0000000741 nova-compute[97948]: WARNING os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 03:42:20.921253 np0000000741 nova-compute[97948]: 
May 14 03:42:20.936942 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999616793000314 future=<Future at 0x79d0b0482270 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:20.938517 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Instance destroyed successfully.
May 14 03:42:20.938973 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'resources' on Instance uuid 4307e5f7-29b9-4320-8fa8-454bf5e15df6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:20.947190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260]
May 14 03:42:20.947190 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260] successful.
May 14 03:42:20.947190 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.963111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.964957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260]
May 14 03:42:20.964957 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260] successful.
May 14 03:42:20.964957 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.974821 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.974821 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.974821 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:20.975006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.975006 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.975006 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:20.975261 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:20.975370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:20.975913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] HCTL ('7', '-', '-', 0) found on session 110 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:20.976004 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:20.985009 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:20.999233 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.999233 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.999233 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:20.999233 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.999233 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:20.999233 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:21.000217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:21.000480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:21.001162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching for a device in session 110 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:21.001315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:21.003101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] HCTL ('8', '-', '-', 0) found on session 111 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:21.003101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:21.024734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching for a device in session 111 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:21.024857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:21.046880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:21.047184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-changed-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:21.047239 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Refreshing instance network info cache due to event network-changed-993f62e1-1c92-4ac3-9f54-b5a02743d55b. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:21.047456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Acquiring lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:21.047681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Acquired lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:21.047884 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Refreshing network info cache for port 993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:21.203802 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a4eaadc4-dfae-4247-8458-07f2f36bc671 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.126s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:21.242847 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005476640003507782 future=<Future at 0x79d0b0483b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.243018 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.243211 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.3825204550003036 future=<Future at 0x79d0b00a9be0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.243781 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.38234703500029354 future=<Future at 0x79d0b00a9be0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.243781 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778730126.2421541, 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:21.244217 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] VM Stopped (Lifecycle Event)
May 14 03:42:21.382776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:21.382988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:21.383210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:21.383400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:21.383574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:21.386705 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Terminating instance
May 14 03:42:21.442051 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173494',display_name='tempest-AttachVolumeNegativeTest-server-1824173494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1824173494',id=39,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoO24CVwVPACn2OkCDXECLoMO9dFffKETeq4hZPQmdtdlXRG1Lyl4DMYBlEYHIzJBqoO1eZWTVh+Mp2mzni+V1k61zItRXu7ldtrWwrXaTl7U8W+/MzArgdSAzbFHEPng==',key_name='tempest-keypair-1990707281',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:26Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-rnv4itm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=4307e5f7-29b9-4320-8fa8-454bf5e15df6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:21.442231 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "6a7592bc-64d2-477a-9da6-e59812eefc96", "address": "fa:16:3e:3b:ed:6e", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7592bc-64", "ovs_interfaceid": "6a7592bc-64d2-477a-9da6-e59812eefc96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:21.442839 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:21.443054 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:21.444143 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.444316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a7592bc-64, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:21.445320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.446086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:21.446836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.447482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.447599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a516d3a-d560-46df-a8bc-e2abad4dffc8) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:21.448086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.448489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:21.449034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.450924 np0000000741 nova-compute[97948]: INFO os_vif [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=6a7592bc-64d2-477a-9da6-e59812eefc96,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7592bc-64')
May 14 03:42:21.451217 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Deleting instance files /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6_del
May 14 03:42:21.452361 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Deletion of /opt/stack/data/nova/instances/4307e5f7-29b9-4320-8fa8-454bf5e15df6_del complete
May 14 03:42:21.551422 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:21.626173 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003965719997722772 future=<Future at 0x79d0b00a9be0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.626616 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Emitting event <LifecycleEvent: 1778730126.625657, dfd56be9-4f58-4af3-8813-8c72452f8ca5 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:21.626776 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.627014 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] VM Stopped (Lifecycle Event)
May 14 03:42:21.629235 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.373257364999972 future=<Future at 0x79d0b0480260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.629404 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.373016130999986 future=<Future at 0x79d0b0480260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:21.749751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-de0f31e1-0198-4304-a920-499a597c0774 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 3f03c2dc-bd78-4a74-bdb3-863ed30a6ce7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:21.832004 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:42:21.890230 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:21.910603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.916792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.936536 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:21.943284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:21.962867 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:42:21.963532 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:21.963918 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:21.964012 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:21.964275 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:22.068850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.075739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.130952 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: dfd56be9-4f58-4af3-8813-8c72452f8ca5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:22.172409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updated VIF entry in instance network info cache for port 993f62e1-1c92-4ac3-9f54-b5a02743d55b. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:22.172409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating instance_info_cache with network_info: [{"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:22.222870 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999705967999944 future=<Future at 0x79d09074aa20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:22.225614 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Instance destroyed successfully.
May 14 03:42:22.225614 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid eb70716b-7c1c-4efe-aec2-f2780ad6ebff {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:22.227677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:22.227945 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:22.232411 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:22.673337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e1f1052-2a03-4094-b668-0a1ffa8715a8 req-d2a47c36-da6c-40b7-9f91-44c9f65c5456 service nova] Releasing lock "refresh_cache-b4494ccc-44c6-427e-b6fb-8223b02e60de" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:22.728069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-662956973',display_name='tempest-ServerRescueNegativeTestJSON-server-662956973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-662956973',id=36,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7S4Hb/1r7evPWnzpybLs/rQIHvlRkCmm0YMZ82RxabhV5HSa0Qay9MVzDwNTpQMzvBRb4viSkxF789Or+6y5CmCDfP6sK5y7rZMpxyAz7n/ybMC9T/sTzhjFhteSeoxw==',key_name='tempest-keypair-104550465',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:33Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-55ih66j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bde0629c78549de8126765cd827cd82',uuid=eb70716b-7c1c-4efe-aec2-f2780ad6ebff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:22.728348 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "81eb0073-bed0-4c79-86a8-bb56d5861294", "address": "fa:16:3e:3a:ff:89", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81eb0073-be", "ovs_interfaceid": "81eb0073-bed0-4c79-86a8-bb56d5861294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:22.728622 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:22.728842 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:22.730174 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:22.735249 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.735434 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81eb0073-be, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:22.737255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.738068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:22.738880 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.739037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbf00ed6-a927-433d-890f-5926139ddcd4) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:22.739436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.740009 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:22.740782 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:22.742529 np0000000741 nova-compute[97948]: INFO os_vif [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:89,bridge_name='br-int',has_traffic_filtering=True,id=81eb0073-bed0-4c79-86a8-bb56d5861294,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81eb0073-be')
May 14 03:42:22.742839 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Deleting instance files /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff_del
May 14 03:42:22.743748 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Deletion of /opt/stack/data/nova/instances/eb70716b-7c1c-4efe-aec2-f2780ad6ebff_del complete
May 14 03:42:22.851363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Found WWN 33000000081858413 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:42:22.851572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:22.851782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000081858413', 'path': '/dev/dm-0', 'multipath_id': '33000000081858413'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:22.851935 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000081858413', 'path': '/dev/dm-0', 'multipath_id': '33000000081858413'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:42:22.923908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:22.924084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Acquiring lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:22.924436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:22.924580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:22.924744 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] No waiting events found dispatching network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:22.924936 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-unplugged-6a7592bc-64d2-477a-9da6-e59812eefc96 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:22.925081 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:22.925258 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:22.925394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:22.925528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:22.925689 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:22.925844 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:22.925996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:22.926146 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Acquiring lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:22.926298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:22.926614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:22.926810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] No waiting events found dispatching network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:22.926965 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-unplugged-81eb0073-bed0-4c79-86a8-bb56d5861294 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:22.927109 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Received event network-vif-deleted-6a7592bc-64d2-477a-9da6-e59812eefc96 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:22.927306 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Neutron deleted interface 6a7592bc-64d2-477a-9da6-e59812eefc96; detaching it from the instance and deleting it from the info cache
May 14 03:42:22.927477 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:23.236367 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:23.238395 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.569s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:23.239430 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:23.251232 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:42:23.251384 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:23.251594 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:23.251723 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:23.251982 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:23.357893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJAaEb7Aw5VXcLzpycVxwcd9o6oTebKWtAqPywhgNRIKAuhok5gdAzse7ORV5yUZmEfupQHP2692VEepEaLPgHQjPHZHgUD/KYqX3LZ90R24RRJ2UgPQFwLTmxG/HKGwg==',key_name='tempest-TestShelveInstance-1074333860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:17Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:23.358232 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:23.359137 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:23.359137 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'pci_devices' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:23.361333 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:23.431349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f6bcc65d-41ba-4c1e-9dfc-718b045298fe req-b33a9d11-e0f9-4237-93db-d4e135d8a52e service nova] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Detach interface failed, port_id=6a7592bc-64d2-477a-9da6-e59812eefc96, reason: Instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:42:23.617438 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.745129 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Took 1.78 seconds to deallocate network for instance.
May 14 03:42:23.747323 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:23.747804 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:23.750555 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:23.750827 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:23.783208 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:23.786968 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:23.795692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.836196 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:23.863179 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <uuid>41fa8526-521c-46aa-af0a-434ff652136e</uuid>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <name>instance-0000002b</name>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestShelveInstance-server-529657334</nova:name>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:19</nova:creationTime>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:user uuid="33d5d5f4d4d84196956203afe36f6d37">tempest-TestShelveInstance-1690582218-project-member</nova:user>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:project uuid="881e23fb403045d89cc278cce41eb2a5">tempest-TestShelveInstance-1690582218</nova:project>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         <nova:port uuid="bee297ca-9526-4351-9c29-e8c837c03eef">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="serial">41fa8526-521c-46aa-af0a-434ff652136e</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="uuid">41fa8526-521c-46aa-af0a-434ff652136e</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <alias name="ua-fcc626a8-7b3a-4876-81c5-83430f2b8fd3"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <serial>fcc626a8-7b3a-4876-81c5-83430f2b8fd3</serial>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:14:69:5e"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <target dev="tapbee297ca-95"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/console.log" append="off"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:23.863179 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:23.865134 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Preparing to wait for external event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:23.865134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:23.865134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:23.865134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:23.865134 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJAaEb7Aw5VXcLzpycVxwcd9o6oTebKWtAqPywhgNRIKAuhok5gdAzse7ORV5yUZmEfupQHP2692VEepEaLPgHQjPHZHgUD/KYqX3LZ90R24RRJ2UgPQFwLTmxG/HKGwg==',key_name='tempest-TestShelveInstance-1074333860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:17Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:23.865496 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:23.866040 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:23.866295 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:23.866775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.867306 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:23.867306 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:23.868325 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.868325 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d3cb81d-ae55-5794-b856-2521f5764493', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:23.869216 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.870040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:23.873560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.873560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbee297ca-95, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:23.873560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbee297ca-95, col_values=(('qos', UUID('e17bd0bb-6de3-43f8-b44b-1b41fe453fcb')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:23.873560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbee297ca-95, col_values=(('external_ids', {'iface-id': 'bee297ca-9526-4351-9c29-e8c837c03eef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:69:5e', 'vm-uuid': '41fa8526-521c-46aa-af0a-434ff652136e'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:23.873935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.875270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:23.881017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:23.881758 np0000000741 nova-compute[97948]: INFO os_vif [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95')
May 14 03:42:24.248459 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:24.254115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:24.254891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:24.284693 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:24.333716 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Successfully created port: 283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:24.751995 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:24.754587 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:24.754871 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:24.783762 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:24.784961 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:24.785658 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:42:24.786324 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:24.786837 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Took 1.53 seconds to deallocate network for instance.
May 14 03:42:24.910360 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Successfully updated port: 283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:24.962714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-changed-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:24.962959 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Refreshing instance network info cache due to event network-changed-283716d9-85e9-4424-ba78-042e2c2365eb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:24.963204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] Acquiring lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:24.963399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] Acquired lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:24.963658 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Refreshing network info cache for port 283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:24.987438 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-77620fa8-c88e-4d50-a8e9-c1906a83ea63 req-076e6491-a7fb-4433-9dd8-acdc626f19ab service nova] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Received event network-vif-deleted-81eb0073-bed0-4c79-86a8-bb56d5861294 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:25.256570 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Booting with volume 5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 at /dev/vda
May 14 03:42:25.258464 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:25.293915 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:25.306440 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:25.320162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:42:25.343566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:25.396351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:42:25.396779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:42:25.400490 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:25.400673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:25.400808 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No VIF found with MAC fa:16:3e:14:69:5e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:25.401417 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Using config drive
May 14 03:42:25.411250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:42:25.412684 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::f07d:d6ff:fecb:27ff', 'fe80::fc16:3eff:fe36:415f', 'fe80::fc16:3eff:feec:7d1a', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe12:87b4', 'fe80::68d4:c9ff:fefa:f980'] 
May 14 03:42:25.414123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:42:25.414499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:25.414670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:42:25.414994 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:25.415317 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating existing volume attachment record: 53e6e05b-4b4a-4a00-8ffa-b2563c627b9c {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:42:25.467615 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:25.568198 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:25.708417 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:25.765828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:25.770121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.474s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:25.781886 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:25.783094 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:25.783673 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:25.864469 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Deleted allocations for instance 4307e5f7-29b9-4320-8fa8-454bf5e15df6
May 14 03:42:25.910415 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:26.114938 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating config drive at /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config
May 14 03:42:26.123114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbiovt0zg {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:26.197513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbiovt0zg" returned: 0 in 0.074s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:26.210757 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7b614053-7f01-4478-a522-b1714f47113c req-ab4ee56d-c9af-4a14-926b-be987a8eb809 service nova] Releasing lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:26.214230 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:26.214230 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:26.296822 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:26.297038 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:26.652003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:26.678717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:26.679672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:26.781982 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:26.783373 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:42:26.802208 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:26.811803 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:26.882499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cbde886a-82c9-459e-9e08-7219cccf5936 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "4307e5f7-29b9-4320-8fa8-454bf5e15df6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.803s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:27.011463 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:27.014709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:27.016912 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:27.042532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:27.061708 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:27.148753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-85c0de2d-09d2-4d5c-8aca-61fb62c9a00c req-8dd0ba9d-b463-4c1e-9304-0d977f53c658 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:27.149069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85c0de2d-09d2-4d5c-8aca-61fb62c9a00c req-8dd0ba9d-b463-4c1e-9304-0d977f53c658 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:27.149529 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85c0de2d-09d2-4d5c-8aca-61fb62c9a00c req-8dd0ba9d-b463-4c1e-9304-0d977f53c658 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:27.149854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-85c0de2d-09d2-4d5c-8aca-61fb62c9a00c req-8dd0ba9d-b463-4c1e-9304-0d977f53c658 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:27.149854 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-85c0de2d-09d2-4d5c-8aca-61fb62c9a00c req-8dd0ba9d-b463-4c1e-9304-0d977f53c658 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Processing event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:27.292466 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:27.316199 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating instance_info_cache with network_info: [{"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:27.319415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.552s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:27.324383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.032s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:27.324815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:27.325842 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:42:27.410482 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Deleted allocations for instance eb70716b-7c1c-4efe-aec2-f2780ad6ebff
May 14 03:42:27.547404 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Creating image(s)
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Ensure instance console log exists: /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:27.549944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:27.565672 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:27.565866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:27.566047 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Shelving
May 14 03:42:27.618085 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730147.6176147, 41fa8526-521c-46aa-af0a-434ff652136e => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:27.618541 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:27.618746 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Started (Lifecycle Event)
May 14 03:42:27.623413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:27.628042 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance spawned successfully.
May 14 03:42:27.629027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:27.827025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:27.827504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance network_info: |[{"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:27.828231 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Start _get_guest_xml network_info=[{"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '54f086cf-6a24-4d22-89e8-6aa82dd7f22c', 'attached_at': '', 'detached_at': '', 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'serial': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'}, 'boot_index': 0, 'attachment_id': '53e6e05b-4b4a-4a00-8ffa-b2563c627b9c', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:27.831303 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:27.832815 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1572383328', uuid='54f086cf-6a24-4d22-89e8-6aa82dd7f22c'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730147.832418) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:27.833979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:27.834451 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:27.835351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:27.835670 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:27.837069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:27.837584 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:27.837947 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:27.838171 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:27.838426 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:27.838664 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:27.838911 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:27.839215 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:27.839440 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:27.839743 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:27.839986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:27.840251 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:27.857701 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:42:27.857701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:27.858076 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:27.858621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:27.859012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:42:27.872146 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:27.872908 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:27.874078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:27.874294 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:27.875022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:27.876827 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:27.887749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:27.887749 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:27.896501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:27.896501 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:27.905420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37] added
May 14 03:42:27.905420 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:27.905420 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:27.905420 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:27.905420 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:27.905420 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:27.905420 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:27.905754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:27.905879 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:27.906074 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:27.913296 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37] added
May 14 03:42:27.913296 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:27.913296 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:27.913296 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:27.913296 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:27.913296 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:27.913296 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:27.913600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:27.913673 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:27.913860 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:28.124365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:28.128427 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:28.137095 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.139679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.139679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.139679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.139679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.139679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:28.257921 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.372520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:28.428202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ecfba092-7fe3-463d-a6f0-799da47be6f9 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "eb70716b-7c1c-4efe-aec2-f2780ad6ebff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.045s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:28.502700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:28.503822 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:28.609974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:28.612147 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.613977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.633142 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:28.637662 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730148.6335, 41fa8526-521c-46aa-af0a-434ff652136e => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:28.637662 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Paused (Lifecycle Event)
May 14 03:42:28.639502 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.652651 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Took 8.87 seconds to spawn the instance on the hypervisor.
May 14 03:42:28.652651 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:28.677562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.786018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:28.873977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:28.878622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:28.879123 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:28.907592 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:28.914577 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:28.924988 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:28.924988 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:28.931178 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance destroyed successfully.
May 14 03:42:28.931485 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'numa_topology' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:28.934954 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:28.934954 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:28.940620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:28.946528 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:28.953872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.953872 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.953872 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:28.954035 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.954035 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.954035 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:28.960197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.960197 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.960197 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:28.960325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.960325 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:28.960325 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:28.987735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.40.100,3260]
May 14 03:42:28.987735 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.40.100,3260] successful.
May 14 03:42:28.987735 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:28.992300 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.50.100,3260]
May 14 03:42:28.992300 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.50.100,3260] successful.
May 14 03:42:28.992300 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:29.002257 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:29.004399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.008625 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.027565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.030285 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:29.030285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:29.030561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:29.031374 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('9', '-', '-', 0) found on session 112 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:29.031567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:29.048588 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:29.048588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('10', '-', '-', 0) found on session 113 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:29.048923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:29.050633 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 112 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:29.051181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:29.065279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 113 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:29.065279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:29.131207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.132872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.155680 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:29.180226 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Took 16.34 seconds to build instance.
May 14 03:42:29.183109 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730149.1827583, 41fa8526-521c-46aa-af0a-434ff652136e => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:29.183364 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Resumed (Lifecycle Event)
May 14 03:42:29.246826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.251005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.296520 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:29.296923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:29.297509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:29.297509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:29.301321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:29.301321 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received unexpected event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with vm_state active and task_state None.
May 14 03:42:29.301535 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:29.303741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:29.303741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:29.303741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:29.303741 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] No waiting events found dispatching network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:29.303741 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b7189c1e-d1d2-4117-bf36-30a79fc6f44e req-d7a92118-94b4-4ff1-bc5b-6d011396bd74 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received unexpected event network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 for instance with vm_state active and task_state shelving.
May 14 03:42:29.358476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.359876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.475534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.475534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.590560 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.592465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.619925 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Beginning cold snapshot process
May 14 03:42:29.684806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f84aac7-1607-4b20-b8f4-54a6987aa3b3 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.851s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:29.686061 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:29.689486 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:29.712386 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.715563 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:42:29.716786 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:29.718078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:29.774378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:29.774846 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12841MB free_disk=73.06376647949219GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:42:29.775032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:29.775360 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:29.877757 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:42:30.004288 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007569559998046316 future=<Future at 0x79d0b0480260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:30.004288 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:30.004288 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.931847654000194 future=<Future at 0x79d0b0482270 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:30.004288 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.931761616000131 future=<Future at 0x79d0b0482270 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:30.005045 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778730135.0023487, d2a0afdf-49df-42a9-b430-11871f7a16ef => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:30.005045 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] VM Stopped (Lifecycle Event)
May 14 03:42:30.192437 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999668149000172 future=<Future at 0x79d0b8617e60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:30.224907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:30.224907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:30.509495 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: d2a0afdf-49df-42a9-b430-11871f7a16ef] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:30.728421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:30.851547 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.851712 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.851826 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ce825ac9-1ee3-49dc-8a58-38a9447e8784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.852204 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance b4494ccc-44c6-427e-b6fb-8223b02e60de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.852204 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 41fa8526-521c-46aa-af0a-434ff652136e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.852204 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 54f086cf-6a24-4d22-89e8-6aa82dd7f22c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:42:30.908182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 33000000094a070ad for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:42:30.908592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:30.908872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000094a070ad', 'path': '/dev/dm-3', 'multipath_id': '33000000094a070ad'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:30.909035 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094a070ad', 'path': '/dev/dm-3', 'multipath_id': '33000000094a070ad'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:42:31.140249 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:42:31.140664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk /opt/stack/data/nova/instances/snapshots/tmpzo0dtx8l/e160f33be1a249b88cd47fda2368cf00 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:31.304529 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:31.355885 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 03:42:31.358134 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:42:31.358666 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:42:29 up 34 min,  2 users,  load average: 6.92, 6.92, 4.34\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_b3eb60c511814747813d717f2e02a441': '2', 'io_workload': '1', 'num_vm_rescued': '1', 'num_task_shelving_image_pending_upload': '1', 'num_proj_bce458cafea74d40af089b430f6b92ce': '1', 'num_proj_e07892e98c064e25b4a6a9069fa574e7': '1', 'num_proj_881e23fb403045d89cc278cce41eb2a5': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:42:31.419862 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1572383328',display_name='tempest-TestVolumeBootPattern-server-1572383328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1572383328',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDbJWInBw2xGvOAdnEdfp19d1MX8zJAaIkkY47pTgTlSD0egqP9F0jdWkgT4bcvWpZ3Cr81LTZrmn2WiwgzR0TiMiyNaQLfQTPTynXBp9dSGStMzi6hwy4yuvEaP9ViUQ==',key_name='tempest-keypair-467670933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-z42f3ec0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=54f086cf-6a24-4d22-89e8-6aa82dd7f22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:31.420047 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:31.420673 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:31.421347 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid 54f086cf-6a24-4d22-89e8-6aa82dd7f22c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:31.463515 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:31.463515 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:31.463781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:31.463941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:31.464453 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] No waiting events found dispatching network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:31.464621 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-c7d99036-1a0a-4cb4-813e-08c7ff2db990 req-7043c387-f815-4137-9dc0-cfab680de3dd service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received unexpected event network-vif-unplugged-e5556cca-f97d-4076-99f5-69c144e18564 for instance with vm_state active and task_state shelving_image_pending_upload.
May 14 03:42:31.470923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk /opt/stack/data/nova/instances/snapshots/tmpzo0dtx8l/e160f33be1a249b88cd47fda2368cf00" returned: 0 in 0.330s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:31.471606 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Snapshot extracted, beginning image upload
May 14 03:42:31.487062 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:31.487062 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing instance network info cache due to event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:31.487062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:31.487062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:31.487062 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:31.522626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:31.523078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:31.525458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:31.525458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:31.525458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:31.527016 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Terminating instance
May 14 03:42:31.584443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.843102 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:31.843402 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:31.926606 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <uuid>54f086cf-6a24-4d22-89e8-6aa82dd7f22c</uuid>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <name>instance-0000002c</name>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-1572383328</nova:name>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:27</nova:creationTime>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         <nova:port uuid="283716d9-85e9-4424-ba78-042e2c2365eb">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="serial">54f086cf-6a24-4d22-89e8-6aa82dd7f22c</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="uuid">54f086cf-6a24-4d22-89e8-6aa82dd7f22c</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/disk.config"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <alias name="ua-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-3"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <serial>5b26d00d-3eeb-4d8d-bd9d-950be5d75e37</serial>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:00:92:1c"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <target dev="tap283716d9-85"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/console.log" append="off"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:31.926606 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Preparing to wait for external event network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1572383328',display_name='tempest-TestVolumeBootPattern-server-1572383328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1572383328',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDbJWInBw2xGvOAdnEdfp19d1MX8zJAaIkkY47pTgTlSD0egqP9F0jdWkgT4bcvWpZ3Cr81LTZrmn2WiwgzR0TiMiyNaQLfQTPTynXBp9dSGStMzi6hwy4yuvEaP9ViUQ==',key_name='tempest-keypair-467670933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-z42f3ec0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=54f086cf-6a24-4d22-89e8-6aa82dd7f22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:31.929923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.930446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:31.930446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:31.931142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.931317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfd1341a-f0bf-5043-8f7f-14dcc2d2f6de', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:31.932044 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.932830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:31.939117 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.941285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.941527 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283716d9-85, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:31.942004 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap283716d9-85, col_values=(('qos', UUID('7ed62de3-7a90-4f40-887a-6d66484fa886')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:31.942230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap283716d9-85, col_values=(('external_ids', {'iface-id': '283716d9-85e9-4424-ba78-042e2c2365eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:92:1c', 'vm-uuid': '54f086cf-6a24-4d22-89e8-6aa82dd7f22c'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:31.943494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.944778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:31.954229 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:31.955451 np0000000741 nova-compute[97948]: INFO os_vif [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85')
May 14 03:42:31.991337 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:32.033607 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:32.073677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.080318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.102439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.225107 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.243666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.346712 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:32.388555 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999574214999939 future=<Future at 0x79d0b01eaf60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:32.392001 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Instance destroyed successfully.
May 14 03:42:32.392001 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:32.440137 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:32.602034 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updated VIF entry in instance network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:32.602490 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:32.858808 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:42:32.859012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.084s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:32.859155 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.555s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:32.860074 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:32.863451 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:32.863620 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Claim successful on node np0000000741
May 14 03:42:32.894634 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952445858',display_name='tempest-ServerRescueNegativeTestJSON-server-1952445858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1952445858',id=32,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:39:49Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-s4b7gp6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:39:50Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=0c5e5102-cad2-4bc4-bf52-30db6ee74fe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:32.894882 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "98fcba70-7fed-4df9-8c59-51793016a49f", "address": "fa:16:3e:36:41:5f", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fcba70-7f", "ovs_interfaceid": "98fcba70-7fed-4df9-8c59-51793016a49f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:32.895539 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:32.895900 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:32.897487 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.897752 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98fcba70-7f, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:32.912934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.913787 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:32.922739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.923790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.923961 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=733c6ccc-e103-4a86-86f9-0b0cbb3f26cb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:32.924543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.925046 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:32.938006 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:32.938006 np0000000741 nova-compute[97948]: INFO os_vif [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:5f,bridge_name='br-int',has_traffic_filtering=True,id=98fcba70-7fed-4df9-8c59-51793016a49f,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fcba70-7f')
May 14 03:42:32.938449 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Deleting instance files /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7_del
May 14 03:42:32.939041 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Deletion of /opt/stack/data/nova/instances/0c5e5102-cad2-4bc4-bf52-30db6ee74fe7_del complete
May 14 03:42:33.104860 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dabb6cff-9fa6-4b88-bd4d-977ea79fffb0 req-167a9c45-9d7e-447c-9af5-46db452557c2 service nova] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:33.361502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:33.361728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:33.444228 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 03:42:33.444907 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:33.445269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:33.445353 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:33.445667 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:33.481830 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:33.482100 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:33.482588 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:00:92:1c, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:33.483394 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Using config drive
May 14 03:42:33.595915 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:33.683318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:33.866696 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:33.989379 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:34.038218 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b84d864c-658f-4664-9601-c53cb1fae057 req-50393a13-f16a-451b-8215-f8f62d659663 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Received event network-vif-deleted-98fcba70-7fed-4df9-8c59-51793016a49f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:34.038403 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-b84d864c-658f-4664-9601-c53cb1fae057 req-50393a13-f16a-451b-8215-f8f62d659663 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Neutron deleted interface 98fcba70-7fed-4df9-8c59-51793016a49f; detaching it from the instance and deleting it from the info cache
May 14 03:42:34.038514 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b84d864c-658f-4664-9601-c53cb1fae057 req-50393a13-f16a-451b-8215-f8f62d659663 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:34.147399 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Creating config drive at /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/disk.config
May 14 03:42:34.152677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps1narui8 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:34.217256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps1narui8" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:34.311476 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Snapshot image upload complete
May 14 03:42:34.311891 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:34.405971 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:34.408993 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:34.409285 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:34.423241 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:34.544853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b84d864c-658f-4664-9601-c53cb1fae057 req-50393a13-f16a-451b-8215-f8f62d659663 service nova] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Detach interface failed, port_id=98fcba70-7fed-4df9-8c59-51793016a49f, reason: Instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:42:34.676939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:34.707095 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:34.803764 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:34.822881 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Shelve offloading
May 14 03:42:34.863593 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15e7211a-8f83-42fd-a9c0-58e120207ac1 req-1edd13d2-e80c-49e5-af32-17997d09667d service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:34.867971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e7211a-8f83-42fd-a9c0-58e120207ac1 req-1edd13d2-e80c-49e5-af32-17997d09667d service nova] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:34.868132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e7211a-8f83-42fd-a9c0-58e120207ac1 req-1edd13d2-e80c-49e5-af32-17997d09667d service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:34.868249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e7211a-8f83-42fd-a9c0-58e120207ac1 req-1edd13d2-e80c-49e5-af32-17997d09667d service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:34.868357 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15e7211a-8f83-42fd-a9c0-58e120207ac1 req-1edd13d2-e80c-49e5-af32-17997d09667d service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Processing event network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:34.911290 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Took 1.47 seconds to deallocate network for instance.
May 14 03:42:34.914062 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:34.990254 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:34.997528 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:34.999769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:35.022187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:35.029371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:35.334184 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance destroyed successfully.
May 14 03:42:35.334654 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:35.336314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:35.336419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:35.336540 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:35.424771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.565s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:35.426077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:35.428632 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:35.430504 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:35.433723 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:35.433837 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Claim successful on node np0000000741
May 14 03:42:35.571427 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730155.5709853, 54f086cf-6a24-4d22-89e8-6aa82dd7f22c => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:35.571559 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] VM Started (Lifecycle Event)
May 14 03:42:35.573183 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:35.578481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:35.580686 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance spawned successfully.
May 14 03:42:35.581160 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:35.841088 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:35.941032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:35.942658 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:35.943593 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:35.944056 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Emitting event <LifecycleEvent: 1778730140.935529, 4307e5f7-29b9-4320-8fa8-454bf5e15df6 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:35.944500 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:35.947854 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.012203026999941358 future=<Future at 0x79d0b0482270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:35.948211 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] VM Stopped (Lifecycle Event)
May 14 03:42:35.951432 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:35.951432 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.272864514000048 future=<Future at 0x79d09074aa20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:35.951432 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.2725671860002876 future=<Future at 0x79d09074aa20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:36.037421 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba9e32f212f04cae8a70c44b26647a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f7491c96154009b61199ad430386d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:36.074622 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:36.079663 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:36.088430 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.088588 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.088917 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.089160 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.091046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.091046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:36.183745 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:36.324603 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:36.446578 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:36.451229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-86d4991d-b38f-4538-932a-871bcc202460 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: 4307e5f7-29b9-4320-8fa8-454bf5e15df6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:36.581101 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:36.581867 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730156.5816832, 54f086cf-6a24-4d22-89e8-6aa82dd7f22c => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:36.581969 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] VM Paused (Lifecycle Event)
May 14 03:42:36.596140 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Took 9.05 seconds to spawn the instance on the hypervisor.
May 14 03:42:36.596306 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:36.608999 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Successfully created port: 2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:36.826656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:36.826971 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:36.827229 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:36.908140 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:36.908386 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:36.928004 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:36.928224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:36.928435 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:36.928619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:36.928811 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] No waiting events found dispatching network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:36.928973 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-94fee962-f527-4ef0-8594-e0f0cb677205 req-3c0ed9a0-3a49-4402-b9d7-35c84163d3d3 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received unexpected event network-vif-plugged-283716d9-85e9-4424-ba78-042e2c2365eb for instance with vm_state active and task_state None.
May 14 03:42:36.951055 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:37.087895 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:37.089488 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730157.0892568, 54f086cf-6a24-4d22-89e8-6aa82dd7f22c => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:37.089687 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] VM Resumed (Lifecycle Event)
May 14 03:42:37.112098 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Took 16.52 seconds to build instance.
May 14 03:42:37.174556 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Successfully updated port: 2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:37.223031 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005011690000173985 future=<Future at 0x79d09074aa20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:37.223154 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:37.223292 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.968729591999818 future=<Future at 0x79d0b8617e60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:37.223368 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.968631199999891 future=<Future at 0x79d0b8617e60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:37.224182 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Emitting event <LifecycleEvent: 1778730142.2224398, eb70716b-7c1c-4efe-aec2-f2780ad6ebff => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:37.224379 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] VM Stopped (Lifecycle Event)
May 14 03:42:37.227652 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-changed-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:37.227860 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Refreshing instance network info cache due to event network-changed-2ccc3361-c6b3-428d-b977-84574e930774. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:37.228086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] Acquiring lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:37.228413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] Acquired lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:37.228413 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Refreshing network info cache for port 2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:37.349173 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance destroyed successfully.
May 14 03:42:37.349726 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'resources' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:37.401667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-changed-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:37.401667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing instance network info cache due to event network-changed-e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:37.401667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:37.401667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:37.401667 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing network info cache for port e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:37.410943 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:37.592169 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:37.593727 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:37.613550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:37.677521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:37.729464 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: eb70716b-7c1c-4efe-aec2-f2780ad6ebff] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:37.730621 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:37.795768 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:37.855663 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:37.855663 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYZtmFiHK6KHeFuAXBdI1WJYwmC3qNFD3NJgQvXxS4dGuTlE2O5jKyAEpDeQLiKqZBheLPcFD/jbIXdzA3rtxGl9jDeO1aT+BuENCIc2YdiaqkamwCd3klfiTt7Yw9zQ==',key_name='tempest-keypair-1108094769',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:45Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:42:34.311567',shelved_host='np0000000741',shelved_image_id='08dd322c-e7fb-4771-afa8-6021e63f73e2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:37.855663 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:37.855663 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:37.855663 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:37.857086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:37.857346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5556cca-f9, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:37.862892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:37.864200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:37.864868 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:37.865063 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea238ead-c5fc-467c-b6a1-705786c26235) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:37.867255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:37.868030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:37.869800 np0000000741 nova-compute[97948]: INFO os_vif [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9')
May 14 03:42:37.870125 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Deleting instance files /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784_del
May 14 03:42:37.878471 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Deletion of /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784_del complete
May 14 03:42:37.909775 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:37.918408 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.493s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:37.919182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:37.923027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.493s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:37.961661 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:37.961661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:37.961661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Creating image(s)
May 14 03:42:37.961661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:37.961661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:37.962603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:37.965657 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:37.967087 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:37.969875 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:37.971374 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:38.074105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:38.075142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:38.075932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:38.076425 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:38.078953 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:38.079356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:38.199008 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:38.199484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:38.262108 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk 1073741824" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:38.263000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:38.263000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:38.367196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:38.367788 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:42:38.368066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:38.404039 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:38.428002 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:38.428351 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:38.428721 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:38.428999 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:38.472399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa3f80c8-233a-492f-8dd8-f4aa869dbd8d req-143d60ec-5c6a-4460-a04e-e148b8b2b24b service nova] Releasing lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:38.474454 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquired lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:38.474454 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:38.489245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:38.489825 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Cannot resize image /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:42:38.490615 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:42:38.491022 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Ensure instance console log exists: /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:38.492271 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:38.492695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:38.495748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:38.509439 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:42:38.554394 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Deleted allocations for instance ce825ac9-1ee3-49dc-8a58-38a9447e8784
May 14 03:42:38.570429 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70bcb0ef074342f2830dfda55709c99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f65182d1764eb393e98fdd7d875119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:38.633114 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:38.633371 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:38.638304 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updated VIF entry in instance network info cache for port e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:38.638688 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape5556cca-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:38.685236 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:38.938954 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:39.045014 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Successfully created port: dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:39.065167 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:39.068232 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:39.137463 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:39.146741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d27fd6ef-e60c-4c46-9c17-e04543a36ff1 req-6f30fdc0-18af-404c-b13c-a17306407bac service nova] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:39.243495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:39.299425 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-changed-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:39.299688 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Refreshing instance network info cache due to event network-changed-283716d9-85e9-4424-ba78-042e2c2365eb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:39.299827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] Acquiring lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:39.299827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] Acquired lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:39.300967 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Refreshing network info cache for port 283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:39.391750 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating instance_info_cache with network_info: [{"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:39.444986 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:39.603795 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Successfully updated port: dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:39.649312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.726s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:39.650840 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.585s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:39.722969 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-changed-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:39.723570 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Refreshing instance network info cache due to event network-changed-dcfb67a9-9969-4652-828e-ee5420d6b500. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:39.724101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] Acquiring lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:39.724218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] Acquired lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:39.724409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Refreshing network info cache for port dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:39.745138 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Deleted allocations for instance 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7
May 14 03:42:39.803002 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:39.894133 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Releasing lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:39.894133 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance network_info: |[{"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:39.896481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Start _get_guest_xml network_info=[{"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:39.898911 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:39.900210 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1764562588', uuid='f4a0bc29-17ad-4cd4-9fde-171f73f30a33'), owner=OwnerMeta(userid='ba9e32f212f04cae8a70c44b26647a59', username='tempest-AttachVolumeNegativeTest-1381632340-project-member', projectid='61f7491c96154009b61199ad430386d3', projectname='tempest-AttachVolumeNegativeTest-1381632340'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730159.8998437) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:39.901409 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:39.901790 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:39.903133 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:39.903449 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:39.904422 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:39.904876 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:39.905099 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:39.905263 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:39.905437 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:39.905563 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:39.905721 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:39.905907 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:39.906059 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:39.906275 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:39.906470 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:39.906674 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:39.924903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764562588',display_name='tempest-AttachVolumeNegativeTest-server-1764562588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1764562588',id=45,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFDXyPR7X2rKfxv8JEGQZYk+OTyPE/DZCgioS8w7J3r6PUIlX6r8pG3zw0RNvBqxZ+DLt1SHudBQH6Xp2RYAkniqafDX53Mj7nPuFrDmIubLllwhQv3r9SE/fWE++I7fg==',key_name='tempest-keypair-576806903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-wtg262g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=f4a0bc29-17ad-4cd4-9fde-171f73f30a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:39.925133 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:39.927932 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:39.931516 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'pci_devices' on Instance uuid f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:40.097529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:40.097733 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:40.106617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:40.184520 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:40.232906 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:40.315544 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updated VIF entry in instance network info cache for port 283716d9-85e9-4424-ba78-042e2c2365eb. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:40.315914 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating instance_info_cache with network_info: [{"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:40.318621 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <uuid>f4a0bc29-17ad-4cd4-9fde-171f73f30a33</uuid>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <name>instance-0000002d</name>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1764562588</nova:name>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:39</nova:creationTime>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:user uuid="ba9e32f212f04cae8a70c44b26647a59">tempest-AttachVolumeNegativeTest-1381632340-project-member</nova:user>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:project uuid="61f7491c96154009b61199ad430386d3">tempest-AttachVolumeNegativeTest-1381632340</nova:project>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         <nova:port uuid="2ccc3361-c6b3-428d-b977-84574e930774">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="serial">f4a0bc29-17ad-4cd4-9fde-171f73f30a33</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="uuid">f4a0bc29-17ad-4cd4-9fde-171f73f30a33</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.config"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:4e:26:ed"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <target dev="tap2ccc3361-c6"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/console.log" append="off"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:40.436104 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Preparing to wait for external event network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:40.436104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764562588',display_name='tempest-AttachVolumeNegativeTest-server-1764562588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1764562588',id=45,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFDXyPR7X2rKfxv8JEGQZYk+OTyPE/DZCgioS8w7J3r6PUIlX6r8pG3zw0RNvBqxZ+DLt1SHudBQH6Xp2RYAkniqafDX53Mj7nPuFrDmIubLllwhQv3r9SE/fWE++I7fg==',key_name='tempest-keypair-576806903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-wtg262g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=f4a0bc29-17ad-4cd4-9fde-171f73f30a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4878cd27-be41-51ab-bceb-64bdec472cc5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:40.442586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.442989 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:40.443862 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.446331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.446680 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ccc3361-c6, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:40.447592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ccc3361-c6, col_values=(('qos', UUID('b8647b14-b109-45d9-986a-c088edbf4b8d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:40.447867 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ccc3361-c6, col_values=(('external_ids', {'iface-id': '2ccc3361-c6b3-428d-b977-84574e930774', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:26:ed', 'vm-uuid': 'f4a0bc29-17ad-4cd4-9fde-171f73f30a33'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:40.448941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.450598 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:40.457980 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:40.459153 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:40.460757 np0000000741 nova-compute[97948]: INFO os_vif [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6')
May 14 03:42:40.461223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:40.461610 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Creating image(s)
May 14 03:42:40.464709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:40.464709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:40.466019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:40.467277 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:40.470099 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:40.474306 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:40.475077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:40.575512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:40.576049 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:40.576740 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:40.577369 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:40.583929 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:40.586018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:40.606660 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:40.679543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:40.681347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:40.744760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk 1073741824" returned: 0 in 0.063s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:40.747032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:40.747333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:40.772447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2a5c747d-e6af-4fa6-b5cb-58d296df9a6d tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "0c5e5102-cad2-4bc4-bf52-30db6ee74fe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.249s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:40.820851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1bda0d3b-2ca4-448c-82db-c7b392660ba0 req-b394699b-e9cf-44b6-a387-2bab605f18af service nova] Releasing lock "refresh_cache-54f086cf-6a24-4d22-89e8-6aa82dd7f22c" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:40.870168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.123s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:40.873662 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:42:40.873662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:40.979276 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c73472b6-ff6d-40b1-846a-b5d4446b16d4 req-1dbac762-4105-472a-8545-f4bd71638a8b service nova] Releasing lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:40.980416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquired lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:40.980629 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:40.985847 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:40.986252 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Cannot resize image /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:42:40.986594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:42:40.986768 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Ensure instance console log exists: /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:40.987526 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:40.987752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:40.988214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:41.115403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.466s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:41.312944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:41.313204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:41.313346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:41.313499 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:41.313598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:41.315959 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Terminating instance
May 14 03:42:41.543179 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:41.574489 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:41.624057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-72c6e6e2-8d54-4416-827b-5866850b0eb5 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.058s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:41.625342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.051s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:41.625584 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Unshelving
May 14 03:42:41.692169 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:41.818778 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:42:41.823118 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Updating instance_info_cache with network_info: [{"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:41.846554 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.849369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.869912 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.874740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.894978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.905934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:41.985694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:41.985837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:41.985978 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:4e:26:ed, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:41.986506 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Using config drive
May 14 03:42:41.994659 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:41.995386 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:41.996000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:41.996928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:41.996928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:41.996928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-800deca4-e285-4b63-9cb4-681c66ed3f80 req-3eeeeb78-9906-4c56-8bfa-11e9dfd1471a service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:42.124529 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.132060 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.139851 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.162097 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999577521000447 future=<Future at 0x79d0907386b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:42.163562 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Instance destroyed successfully.
May 14 03:42:42.164071 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lazy-loading 'resources' on Instance uuid 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:42.327021 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Releasing lock "refresh_cache-bf111060-82e6-4fb4-84c4-262006fd00a0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:42.327478 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance network_info: |[{"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:42.332018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Start _get_guest_xml network_info=[{"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:42.336380 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:42.338056 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1191634951', uuid='bf111060-82e6-4fb4-84c4-262006fd00a0'), owner=OwnerMeta(userid='70bcb0ef074342f2830dfda55709c99e', username='tempest-ServersNegativeTestJSON-1531732290-project-member', projectid='05f65182d1764eb393e98fdd7d875119', projectname='tempest-ServersNegativeTestJSON-1531732290'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730162.3375745) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:42.339737 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:42.340144 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:42.341186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:42.341390 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:42.342548 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:42.343027 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:42.343326 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:42.343650 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:42.343865 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:42.344000 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:42.344145 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:42.344497 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:42.344655 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:42.344841 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:42.344996 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:42.345159 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:42.363256 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191634951',display_name='tempest-ServersNegativeTestJSON-server-1191634951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-1191634951',id=46,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-8l70hd6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:39Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=bf111060-82e6-4fb4-84c4-262006fd00a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:42.363549 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:42.364378 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:42.365180 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lazy-loading 'pci_devices' on Instance uuid bf111060-82e6-4fb4-84c4-262006fd00a0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:42.495947 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:42.630522 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Creating config drive at /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.config
May 14 03:42:42.634968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp39tq18vx {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:42.670520 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1705297539',display_name='tempest-ServerRescueNegativeTestJSON-server-1705297539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serverrescuenegativetestjson-server-1705297539',id=31,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:40:05Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3eb60c511814747813d717f2e02a441',ramdisk_id='',reservation_id='r-waw0p200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1232860846',owner_user_name='tempest-ServerRescueNegativeTestJSON-1232860846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:40:12Z,user_data=None,user_id='2bde0629c78549de8126765cd827cd82',uuid=1c7ec2de-3093-4b9c-9b5b-58aad8cf125c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:42:42.673956 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converting VIF {"id": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "address": "fa:16:3e:ec:7d:1a", "network": {"id": "8f7a19a7-d809-4ca4-9e3d-c67c344f02ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-846554723-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b3eb60c511814747813d717f2e02a441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbf6dd-59", "ovs_interfaceid": "decbf6dd-5954-4ec6-8e05-f7397f8b9453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:42.675151 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:42.675525 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:42:42.681511 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.681890 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecbf6dd-59, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.684236 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.684608 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:42.689179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.690180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.690375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a6764c8-84bd-4f7d-96ab-03f7697e77d7) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.691526 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.691608 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:42.696354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp39tq18vx" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:42.703259 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.703259 np0000000741 nova-compute[97948]: INFO os_vif [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7d:1a,bridge_name='br-int',has_traffic_filtering=True,id=decbf6dd-5954-4ec6-8e05-f7397f8b9453,network=Network(8f7a19a7-d809-4ca4-9e3d-c67c344f02ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbf6dd-59')
May 14 03:42:42.703259 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Deleting instance files /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c_del
May 14 03:42:42.703259 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Deletion of /opt/stack/data/nova/instances/1c7ec2de-3093-4b9c-9b5b-58aad8cf125c_del complete
May 14 03:42:42.712976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:42.713187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:42.714915 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_requests' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:42.868499 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <uuid>bf111060-82e6-4fb4-84c4-262006fd00a0</uuid>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <name>instance-0000002e</name>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServersNegativeTestJSON-server-1191634951</nova:name>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:42</nova:creationTime>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:user uuid="70bcb0ef074342f2830dfda55709c99e">tempest-ServersNegativeTestJSON-1531732290-project-member</nova:user>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:project uuid="05f65182d1764eb393e98fdd7d875119">tempest-ServersNegativeTestJSON-1531732290</nova:project>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         <nova:port uuid="dcfb67a9-9969-4652-828e-ee5420d6b500">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="serial">bf111060-82e6-4fb4-84c4-262006fd00a0</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="uuid">bf111060-82e6-4fb4-84c4-262006fd00a0</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.config"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b5:c5:f9"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <target dev="tapdcfb67a9-99"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/console.log" append="off"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:42.868499 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Preparing to wait for external event network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191634951',display_name='tempest-ServersNegativeTestJSON-server-1191634951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-1191634951',id=46,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-8l70hd6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:39Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=bf111060-82e6-4fb4-84c4-262006fd00a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:42.871414 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:42.873884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.874094 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.874281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:42.874966 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.875135 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20c61483-963d-529f-bd85-edec42b1aa56', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.875905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.876543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:42.882043 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.884558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.884741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcfb67a9-99, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.885038 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcfb67a9-99, col_values=(('qos', UUID('7473dfd2-9c2b-4dec-a748-fee01c25b627')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.885202 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcfb67a9-99, col_values=(('external_ids', {'iface-id': 'dcfb67a9-9969-4652-828e-ee5420d6b500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:c5:f9', 'vm-uuid': 'bf111060-82e6-4fb4-84c4-262006fd00a0'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:42.889816 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.890970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:42.896228 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:42.897185 np0000000741 nova-compute[97948]: INFO os_vif [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99')
May 14 03:42:43.132783 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.167031 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.171970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.211905 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:42:43.212829 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:42:43.213170 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:42:43.213293 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:42:43.213675 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:43.218506 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'numa_topology' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:43.264443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.300759 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:43.481574 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.490581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.496730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.520100 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.522309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.687336 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:43.721701 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:43.721959 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Claim successful on node np0000000741
May 14 03:42:44.001245 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730164.0001924, f4a0bc29-17ad-4cd4-9fde-171f73f30a33 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:44.001245 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] VM Started (Lifecycle Event)
May 14 03:42:44.077736 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:44.077917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Acquiring lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:44.078100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:44.078265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:44.078483 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] No waiting events found dispatching network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:44.078653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-unplugged-decbf6dd-5954-4ec6-8e05-f7397f8b9453 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:42:44.078803 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:44.079396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Processing event network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] No waiting events found dispatching network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received unexpected event network-vif-plugged-2ccc3361-c6b3-428d-b977-84574e930774 for instance with vm_state building and task_state spawning.
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Received event network-vif-deleted-decbf6dd-5954-4ec6-8e05-f7397f8b9453 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Neutron deleted interface decbf6dd-5954-4ec6-8e05-f7397f8b9453; detaching it from the instance and deleting it from the info cache
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:44.082711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:44.089439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:44.092632 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance spawned successfully.
May 14 03:42:44.092897 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:44.148211 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:44.423960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:44.424114 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:44.424264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No VIF found with MAC fa:16:3e:b5:c5:f9, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:44.424791 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Using config drive
May 14 03:42:44.503866 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:44.512891 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:44.585801 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9fe9dba5-4819-422a-a728-ea1606d87649 req-8b4527a9-1977-45cc-b09e-6e262bb03494 service nova] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Detach interface failed, port_id=decbf6dd-5954-4ec6-8e05-f7397f8b9453, reason: Instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:42:44.599028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.599319 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.599869 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.600312 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.600769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.601069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:44.650212 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Took 1.44 seconds to deallocate network for instance.
May 14 03:42:44.935586 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:45.015761 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:45.018317 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730165.0180035, f4a0bc29-17ad-4cd4-9fde-171f73f30a33 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:45.018514 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] VM Paused (Lifecycle Event)
May 14 03:42:45.107128 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Took 7.15 seconds to spawn the instance on the hypervisor.
May 14 03:42:45.107276 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:45.124323 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Creating config drive at /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.config
May 14 03:42:45.129013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp_ct6ypj {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:45.163602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:45.185767 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:45.185970 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:45.193478 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0014020140001775871 future=<Future at 0x79d0b8617e60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:45.193606 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:45.193717 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.1942110159998265 future=<Future at 0x79d0b01eaf60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:45.193817 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.194103036999877 future=<Future at 0x79d0b01eaf60 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:45.194344 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730150.191945, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:45.194523 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Stopped (Lifecycle Event)
May 14 03:42:45.201078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp_ct6ypj" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:45.529712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:45.532237 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730165.5319855, f4a0bc29-17ad-4cd4-9fde-171f73f30a33 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:45.532402 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] VM Resumed (Lifecycle Event)
May 14 03:42:45.626105 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Took 14.39 seconds to build instance.
May 14 03:42:45.678439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:45.692532 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:45.702605 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7cbd953d-7d09-4806-a97f-71435d0798b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:45.707560 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:45.709513 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:45.842173 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:45.895616 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ecd36a8-ca62-4329-b1a6-d1ca8d6f6749 req-461337d3-6b9f-43dc-beab-1a0b22f37f71 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:45.896243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ecd36a8-ca62-4329-b1a6-d1ca8d6f6749 req-461337d3-6b9f-43dc-beab-1a0b22f37f71 service nova] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:45.896322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ecd36a8-ca62-4329-b1a6-d1ca8d6f6749 req-461337d3-6b9f-43dc-beab-1a0b22f37f71 service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:45.896486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ecd36a8-ca62-4329-b1a6-d1ca8d6f6749 req-461337d3-6b9f-43dc-beab-1a0b22f37f71 service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:45.896686 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ecd36a8-ca62-4329-b1a6-d1ca8d6f6749 req-461337d3-6b9f-43dc-beab-1a0b22f37f71 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Processing event network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:46.036501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:46.038009 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:46.039633 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:46.045139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:46.046510 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:46.048845 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:46.072677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:46.132323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-039388fa-976f-46fe-a92a-546b7038629d tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.908s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:46.205753 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.492s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:46.206341 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.043s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:46.209766 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:46.323833 np0000000741 nova-compute[97948]: INFO nova.network.neutron [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating port e5556cca-f97d-4076-99f5-69c144e18564 with attributes {'binding:host_id': 'np0000000741', 'device_owner': 'compute:nova'}
May 14 03:42:46.665121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:46.669246 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730166.6653442, bf111060-82e6-4fb4-84c4-262006fd00a0 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:46.669246 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] VM Started (Lifecycle Event)
May 14 03:42:46.676069 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:46.678943 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance spawned successfully.
May 14 03:42:46.688127 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:42:46.744606 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:46.744606 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:46.958986 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:46.959101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:46.959230 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:47.174734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:47.177746 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:47.197393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.197780 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.198101 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.198310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.198622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.198909 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:42:47.248986 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:47.366380 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-changed-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:47.366883 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Refreshing instance network info cache due to event network-changed-2ccc3361-c6b3-428d-b977-84574e930774. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:47.367055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] Acquiring lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:47.367144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] Acquired lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:47.367274 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Refreshing network info cache for port 2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:47.388300 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000339784000061627 future=<Future at 0x79d0b01eaf60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:47.388681 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Emitting event <LifecycleEvent: 1778730152.3878503, 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:47.388811 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:47.388961 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] VM Stopped (Lifecycle Event)
May 14 03:42:47.389054 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.772542140000041 future=<Future at 0x79d0907386b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:47.389915 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.77168472800031 future=<Future at 0x79d0907386b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:47.461114 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:47.680155 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:47.680913 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730167.6802297, bf111060-82e6-4fb4-84c4-262006fd00a0 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:47.680913 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] VM Paused (Lifecycle Event)
May 14 03:42:47.703016 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Took 7.24 seconds to spawn the instance on the hypervisor.
May 14 03:42:47.703577 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:47.762436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.555s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:47.783398 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:47.866024 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Deleted allocations for instance 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c
May 14 03:42:47.871718 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:47.886903 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:47.892051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a7883e35-b06f-4117-9ca5-eb55fb7fbff1 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] [instance: 0c5e5102-cad2-4bc4-bf52-30db6ee74fe7] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:47.962446 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:47.980886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:47.981138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:47.981337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:47.981477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:47.981621 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] No waiting events found dispatching network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:47.981783 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received unexpected event network-vif-plugged-dcfb67a9-9969-4652-828e-ee5420d6b500 for instance with vm_state active and task_state None.
May 14 03:42:47.981905 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-changed-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:47.982006 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing instance network info cache due to event network-changed-e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:47.982614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Acquiring lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:48.183030 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:48.184870 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730168.1846302, bf111060-82e6-4fb4-84c4-262006fd00a0 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:48.185013 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] VM Resumed (Lifecycle Event)
May 14 03:42:48.216830 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Took 13.84 seconds to build instance.
May 14 03:42:48.465047 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:48.466290 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:48.466625 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating image(s)
May 14 03:42:48.467260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:48.467477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:48.467786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Acquired lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:48.468081 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Refreshing network info cache for port e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:48.471881 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:48.472026 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:48.688015 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:48.690043 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:48.692771 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:48.712914 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:48.718528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.357s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:48.838414 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updated VIF entry in instance network info cache for port 2ccc3361-c6b3-428d-b977-84574e930774. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:48.838867 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating instance_info_cache with network_info: [{"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:48.876510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3a36f3d-eec8-4785-b205-1f1482a3d074 tempest-ServerRescueNegativeTestJSON-1232860846 tempest-ServerRescueNegativeTestJSON-1232860846-project-member] Lock "1c7ec2de-3093-4b9c-9b5b-58aad8cf125c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.563s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:48.974860 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:48.976633 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:48.976862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "dccc80477b739457f612615f0d5b3ed68025ee3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:48.977219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "dccc80477b739457f612615f0d5b3ed68025ee3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:49.342924 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5713446-478e-4b3f-9024-c4f40bb646ad req-883f0bfa-b948-40e4-99be-9caf76865fb5 service nova] Releasing lock "refresh_cache-f4a0bc29-17ad-4cd4-9fde-171f73f30a33" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:49.490433 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:49.683441 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updated VIF entry in instance network info cache for port e5556cca-f97d-4076-99f5-69c144e18564. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:42:49.684230 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:49.885752 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:49.889970 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:49.890399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:49.957411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:49.957411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:49.994890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.part --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:49.995338 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] 08dd322c-e7fb-4771-afa8-6021e63f73e2 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:42:49.996150 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:42:49.996451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.part /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.175012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.part /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.converted" returned: 0 in 0.178s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.189022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-193d7977-6500-4f8d-a1b1-05e92fb4ed3c req-00be36e4-b061-4be8-8bd6-247560bea3bc service nova] Releasing lock "refresh_cache-ce825ac9-1ee3-49dc-8a58-38a9447e8784" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:50.191665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.288291 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.289030 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "dccc80477b739457f612615f0d5b3ed68025ee3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.312s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:50.289559 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:50.292657 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:50.293803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.382649 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.383365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "dccc80477b739457f612615f0d5b3ed68025ee3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:50.383939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "dccc80477b739457f612615f0d5b3ed68025ee3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:50.384557 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:50.389044 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:50.390586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.460604 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:42:50.505524 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.506039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b,backing_fmt=raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.578326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b,backing_fmt=raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk 1073741824" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.578738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "dccc80477b739457f612615f0d5b3ed68025ee3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:50.579075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:50.668720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dccc80477b739457f612615f0d5b3ed68025ee3b --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:50.669674 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'migration_context' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:50.973730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:51.044592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:51.045112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:51.051101 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:42:51.051528 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Claim successful on node np0000000741
May 14 03:42:51.172851 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:51.175232 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Rebasing disk image.
May 14 03:42:51.175232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:51.268998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:51.272662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 -F raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:52.157557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 -F raw /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk" returned: 0 in 0.888s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:52.159304 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:42:52.162016 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Ensure instance console log exists: /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:52.165663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:52.165663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:52.165663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:52.165663 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start _get_guest_xml network_info=[{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='37e7228e3fb43be365b1bf9d7003e68a',container_format='bare',created_at=2026-05-14T03:42:27Z,direct_url=<?>,disk_format='qcow2',id=08dd322c-e7fb-4771-afa8-6021e63f73e2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-189719289-shelved',owner='bce458cafea74d40af089b430f6b92ce',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T03:42:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:52.169955 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:52.172076 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-189719289', uuid='ce825ac9-1ee3-49dc-8a58-38a9447e8784'), owner=OwnerMeta(userid='755776b8b15e43bbac70f82cfea689e2', username='tempest-AttachVolumeShelveTestJSON-1886486107-project-member', projectid='bce458cafea74d40af089b430f6b92ce', projectname='tempest-AttachVolumeShelveTestJSON-1886486107'), image=ImageMeta(id='08dd322c-e7fb-4771-afa8-6021e63f73e2', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730172.1716526) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:52.173409 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:52.173940 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:52.174846 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:52.175144 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:52.176217 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:52.176699 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='37e7228e3fb43be365b1bf9d7003e68a',container_format='bare',created_at=2026-05-14T03:42:27Z,direct_url=<?>,disk_format='qcow2',id=08dd322c-e7fb-4771-afa8-6021e63f73e2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-189719289-shelved',owner='bce458cafea74d40af089b430f6b92ce',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T03:42:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:52.176955 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:52.177147 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:52.177396 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:52.177585 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:52.177780 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:52.178004 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:52.178213 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:52.178509 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:52.178758 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:52.178945 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:52.179239 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:52.505989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:42:52.506334 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:42:52.683660 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:52.693350 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='08dd322c-e7fb-4771-afa8-6021e63f73e2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1108094769',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:45Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:42:34.311567',shelved_host='np0000000741',shelved_image_id='08dd322c-e7fb-4771-afa8-6021e63f73e2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:52.693829 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:52.694878 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:52.695663 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'pci_devices' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:52.887889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.010928 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:42:53.197907 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:53.199893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <uuid>ce825ac9-1ee3-49dc-8a58-38a9447e8784</uuid>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <name>instance-00000028</name>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-189719289</nova:name>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:52</nova:creationTime>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:user uuid="755776b8b15e43bbac70f82cfea689e2">tempest-AttachVolumeShelveTestJSON-1886486107-project-member</nova:user>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:project uuid="bce458cafea74d40af089b430f6b92ce">tempest-AttachVolumeShelveTestJSON-1886486107</nova:project>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         <nova:port uuid="e5556cca-f97d-4076-99f5-69c144e18564">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="serial">ce825ac9-1ee3-49dc-8a58-38a9447e8784</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="uuid">ce825ac9-1ee3-49dc-8a58-38a9447e8784</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b3:ac:cc"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <target dev="tape5556cca-f9"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/console.log" append="off"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:53.199893 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Preparing to wait for external event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='08dd322c-e7fb-4771-afa8-6021e63f73e2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1108094769',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:41:45Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member',shelved_at='2026-05-14T03:42:34.311567',shelved_host='np0000000741',shelved_image_id='08dd322c-e7fb-4771-afa8-6021e63f73e2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:53.205410 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:53.206735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.206735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:53.206735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:53.208054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.208054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b516e226-6c4b-54a8-8ada-8c33e766e244', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:53.208514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.209372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:53.210375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.214068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.214068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5556cca-f9, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:53.214709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5556cca-f9, col_values=(('qos', UUID('860dfd96-cd6c-49bc-a4a0-684c694a5b8d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:53.215017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5556cca-f9, col_values=(('external_ids', {'iface-id': 'e5556cca-f97d-4076-99f5-69c144e18564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:ac:cc', 'vm-uuid': 'ce825ac9-1ee3-49dc-8a58-38a9447e8784'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:53.218089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.218089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:53.224262 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:53.224767 np0000000741 nova-compute[97948]: INFO os_vif [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9')
May 14 03:42:53.523045 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.478s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:53.523500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:42:53.693887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:54.034263 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:42:54.034263 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:42:54.034263 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:54.034263 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:54.145669 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70bcb0ef074342f2830dfda55709c99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f65182d1764eb393e98fdd7d875119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:42:54.293443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:54.294584 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:54.535599 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:42:54.657734 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Successfully created port: 5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:42:54.743611 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:54.743611 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:42:54.743611 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] No VIF found with MAC fa:16:3e:b3:ac:cc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:42:54.743611 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Using config drive
May 14 03:42:54.799633 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lazy-loading 'flavor' on Instance uuid b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:55.031511 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:55.042313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:42:55.245361 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'ec2_ids' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:55.302526 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Ignoring supplied device name: /dev/vdb
May 14 03:42:55.633215 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Successfully updated port: 5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:42:55.716526 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-changed-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:55.716730 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Refreshing instance network info cache due to event network-changed-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:42:55.716955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] Acquiring lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:55.717042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] Acquired lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:55.717199 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Refreshing network info cache for port 5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:42:55.748536 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:55.748754 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'keypairs' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:55.804731 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:56.056912 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:42:56.058161 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:42:56.058461 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Creating image(s)
May 14 03:42:56.058950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:56.059150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:56.059690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:56.060275 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:56.064395 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:56.065568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.141933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:42:56.158776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.159397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:56.159770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:56.160269 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:56.163651 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:42:56.164186 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.221271 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:56.251998 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Object Instance<ce825ac9-1ee3-49dc-8a58-38a9447e8784> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:42:56.255616 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:56.258305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.258866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.336244 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk 1073741824" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.336872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:56.337368 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.451875 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.452461 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:42:56.453128 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.535089 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Creating config drive at /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config
May 14 03:42:56.539780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps_sfv14_ {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:56.558151 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.558905 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Cannot resize image /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:42:56.559766 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:42:56.560120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Ensure instance console log exists: /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:42:56.560689 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:56.561288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:56.561542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:56.572323 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:56.596303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps_sfv14_" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:42:56.860732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:56.936314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:56.936490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:56.938442 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Attaching volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf to /dev/vdb
May 14 03:42:56.945386 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:57.009688 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:57.027511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:42:57.069156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:42:57.109497 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.125899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:42:57.126357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:42:57.144527 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.146794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:42:57.153096 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe12:87b4', 'fe80::68d4:c9ff:fefa:f980', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe00:921c', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe4e:26ed', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:feb5:c5f9', 'fe80::a40d:d8ff:fedd:bd7e', 'fe80::fc16:3eff:feb3:accc'] 
May 14 03:42:57.153255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:42:57.153397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:42:57.153722 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:42:57.154050 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating existing volume attachment record: b4ad2543-3e2b-439e-bcc0-46b3ae04b2f4 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:42:57.162292 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005908899997848494 future=<Future at 0x79d0907386b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:57.166425 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730162.1615133, 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:57.166425 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:42:57.166425 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] VM Stopped (Lifecycle Event)
May 14 03:42:57.234866 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.331199 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a77caae4-d89a-4c4b-9b26-8aa538ae6250 req-d4b50606-dbd8-456c-af3e-03fa52cfafd7 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:57.331199 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a77caae4-d89a-4c4b-9b26-8aa538ae6250 req-d4b50606-dbd8-456c-af3e-03fa52cfafd7 service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:57.331432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a77caae4-d89a-4c4b-9b26-8aa538ae6250 req-d4b50606-dbd8-456c-af3e-03fa52cfafd7 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:57.331574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a77caae4-d89a-4c4b-9b26-8aa538ae6250 req-d4b50606-dbd8-456c-af3e-03fa52cfafd7 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:57.331737 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a77caae4-d89a-4c4b-9b26-8aa538ae6250 req-d4b50606-dbd8-456c-af3e-03fa52cfafd7 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Processing event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:42:57.449960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3b56c11a-29bd-46d3-9827-cc8dfe9d043e req-07a77710-6f27-4600-96df-ecdea335a055 service nova] Releasing lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:57.452273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquired lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:42:57.452273 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:42:57.497070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.499244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.509847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.530001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:57.673271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d6513dcd-bd79-4ffc-840b-956e1e92fea1 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 1c7ec2de-3093-4b9c-9b5b-58aad8cf125c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:57.736599 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:42:57.737492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:42:57.737492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:57.737928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:57.738191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:42:57.757674 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:57.758717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:42:57.759404 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:57.760085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:42:57.760491 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:57.760873 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:57.775621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:57.775621 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:57.786160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:42:57.786160 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:57.791659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf] added
May 14 03:42:57.791659 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:57.791659 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:57.791659 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:57.791659 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:57.791659 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:57.791659 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:57.792043 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:57.792120 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:57.792334 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:57.801243 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf] added
May 14 03:42:57.801243 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:42:57.801243 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:57.801243 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:57.801243 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:42:57.801243 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:42:57.801243 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:57.801576 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:42:57.801625 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0412(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:42:57.801878 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:42:58.044094 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:42:58.071883 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730178.0715253, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:58.072028 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Started (Lifecycle Event)
May 14 03:42:58.075535 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:42:58.078092 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:42:58.081790 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance spawned successfully.
May 14 03:42:58.217198 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:58.244537 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:42:58.416252 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Updating instance_info_cache with network_info: [{"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:42:58.553065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:58.576241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:58.578317 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:42:58.694086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:58.792889 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:42:58.802331 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:58.808800 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:58.808800 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:42:58.823849 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:42:58.823849 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.833307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.841312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.848891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.848891 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.848891 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.848891 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.848891 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:58.849182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.849182 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.849182 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.849182 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.849182 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:58.857198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.857198 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.857198 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.857198 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.857198 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:58.857482 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.857482 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.857482 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.857482 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.857482 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:58.894524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.40.100,3260]
May 14 03:42:58.894524 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.40.100,3260] successful.
May 14 03:42:58.894524 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.906096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.916183 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.50.100,3260]
May 14 03:42:58.916183 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.50.100,3260] successful.
May 14 03:42:58.916183 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.925351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Releasing lock "refresh_cache-d734a321-467c-4d7c-b131-a507b95c1f0e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:42:58.925630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance network_info: |[{"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:42:58.928233 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Start _get_guest_xml network_info=[{"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.929039 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.929255 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:58.929719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:58.929912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:58.932302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:42:58.932779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] HCTL ('11', '-', '-', 0) found on session 114 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:58.932985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:58.934887 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:42:58.936657 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-993909987', uuid='d734a321-467c-4d7c-b131-a507b95c1f0e'), owner=OwnerMeta(userid='70bcb0ef074342f2830dfda55709c99e', username='tempest-ServersNegativeTestJSON-1531732290-project-member', projectid='05f65182d1764eb393e98fdd7d875119', projectname='tempest-ServersNegativeTestJSON-1531732290'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730178.936173) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:42:58.938214 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:42:58.938529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:42:58.939626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:42:58.939891 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:42:58.943420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.953473 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:42:58.954481 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:42:58.954481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:42:58.966740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] HCTL ('12', '-', '-', 0) found on session 115 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:42:58.966908 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:42:58.968575 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Searching for a device in session 114 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:58.968965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:58.973119 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-993909987',display_name='tempest-ServersNegativeTestJSON-server-993909987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-993909987',id=47,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-70gy7g0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:55Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=d734a321-467c-4d7c-b131-a507b95c1f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:42:58.973657 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:58.974570 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:58.975423 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lazy-loading 'pci_devices' on Instance uuid d734a321-467c-4d7c-b131-a507b95c1f0e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:42:58.989998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Searching for a device in session 115 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:42:58.989998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:42:59.064614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-da74629b-f4e9-4f54-80cb-1452785dd795 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.439s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:59.081979 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:42:59.083082 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730179.0828457, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:59.083233 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Paused (Lifecycle Event)
May 14 03:42:59.409985 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:42:59.410700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:59.410700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:59.410700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:59.410700 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] No waiting events found dispatching network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:42:59.410991 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-2ff83b34-45f4-42d2-9ee7-6cb44044f7fb req-7d46c13d-c883-41bf-a22f-a8e0c06e23a2 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received unexpected event network-vif-plugged-e5556cca-f97d-4076-99f5-69c144e18564 for instance with vm_state active and task_state None.
May 14 03:42:59.478687 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] End _get_guest_xml xml=<domain type="qemu">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <uuid>d734a321-467c-4d7c-b131-a507b95c1f0e</uuid>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <name>instance-0000002f</name>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:name>tempest-ServersNegativeTestJSON-server-993909987</nova:name>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:42:58</nova:creationTime>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:user uuid="70bcb0ef074342f2830dfda55709c99e">tempest-ServersNegativeTestJSON-1531732290-project-member</nova:user>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:project uuid="05f65182d1764eb393e98fdd7d875119">tempest-ServersNegativeTestJSON-1531732290</nova:project>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         <nova:port uuid="5ccf15eb-9136-4193-9f0d-cdd668e0e5f3">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <system>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="serial">d734a321-467c-4d7c-b131-a507b95c1f0e</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="uuid">d734a321-467c-4d7c-b131-a507b95c1f0e</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </system>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <os>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </os>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <features>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </features>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   <devices>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.config"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </disk>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3f:cf:79"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <target dev="tap5ccf15eb-91"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </interface>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/console.log" append="off"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </serial>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <video>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </video>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </rng>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:   </devices>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]: </domain>
May 14 03:42:59.478687 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Preparing to wait for external event network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-993909987',display_name='tempest-ServersNegativeTestJSON-server-993909987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-993909987',id=47,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-70gy7g0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:42:55Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=d734a321-467c-4d7c-b131-a507b95c1f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:42:59.481317 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16cd9bcc-5fb2-56b7-a9d5-55bb37849ddf', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:59.484906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.485713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:59.485914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.487869 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.488017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccf15eb-91, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:59.488367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccf15eb-91, col_values=(('qos', UUID('4284a679-b24e-4eeb-a021-a1a522f55435')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:59.488490 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccf15eb-91, col_values=(('external_ids', {'iface-id': '5ccf15eb-9136-4193-9f0d-cdd668e0e5f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:cf:79', 'vm-uuid': 'd734a321-467c-4d7c-b131-a507b95c1f0e'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:42:59.491630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.494318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:42:59.499563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:42:59.501723 np0000000741 nova-compute[97948]: INFO os_vif [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91')
May 14 03:42:59.586936 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:42:59.588747 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730179.5883932, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:42:59.588926 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Resumed (Lifecycle Event)
May 14 03:42:59.760835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:43:00.091724 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:00.093878 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:00.476665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:00.476880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:00.777922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Found WWN 330000000cc310996 for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:43:00.778386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:00.778511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000cc310996', 'path': '/dev/dm-6', 'multipath_id': '330000000cc310996'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:00.778661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc310996', 'path': '/dev/dm-6', 'multipath_id': '330000000cc310996'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:43:00.781330 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lazy-loading 'flavor' on Instance uuid b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:00.979005 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:43:01.020119 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:01.020439 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:01.020622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] No VIF found with MAC fa:16:3e:3f:cf:79, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:01.021239 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Using config drive
May 14 03:43:01.284541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Attempting to attach volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:43:01.286132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:   <alias name="ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf"/>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:   <serial>6e6f3018-fc2f-436e-be2f-5dd1b35b43cf</serial>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:01.286132 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:43:01.526648 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:01.533518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:01.534320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:01.539227 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:01.539227 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Claim successful on node np0000000741
May 14 03:43:01.763995 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Creating config drive at /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.config
May 14 03:43:01.768104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpym3o260l {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:01.845339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpym3o260l" returned: 0 in 0.077s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:02.338709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:02.365395 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:02.496986 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:02.497742 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:02.567970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40829ff4-21f9-4ca7-befc-24b8c61f59d8 req-f3517d24-dbd6-4740-ad26-1b60f530ddea service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:02.568221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40829ff4-21f9-4ca7-befc-24b8c61f59d8 req-f3517d24-dbd6-4740-ad26-1b60f530ddea service nova] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:02.568404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40829ff4-21f9-4ca7-befc-24b8c61f59d8 req-f3517d24-dbd6-4740-ad26-1b60f530ddea service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:02.568613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40829ff4-21f9-4ca7-befc-24b8c61f59d8 req-f3517d24-dbd6-4740-ad26-1b60f530ddea service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:02.568705 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40829ff4-21f9-4ca7-befc-24b8c61f59d8 req-f3517d24-dbd6-4740-ad26-1b60f530ddea service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Processing event network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:02.946290 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:02.946824 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:02.946824 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:02.948017 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] No VIF found with MAC fa:16:3e:12:87:b4, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:03.085029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:03.085309 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:03.331937 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730183.3311603, d734a321-467c-4d7c-b131-a507b95c1f0e => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:03.332219 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] VM Started (Lifecycle Event)
May 14 03:43:03.334043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:03.336312 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:03.339694 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance spawned successfully.
May 14 03:43:03.341253 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:43:03.588198 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:03.711186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:03.834803 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:03.836538 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:03.848814 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:03.848814 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:03.848814 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:03.849476 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:03.850050 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:03.850462 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:04.094576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.560s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:04.095098 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:43:04.339173 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:43:04.339497 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730184.3392935, d734a321-467c-4d7c-b131-a507b95c1f0e => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:04.339670 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] VM Paused (Lifecycle Event)
May 14 03:43:04.355999 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Took 8.30 seconds to spawn the instance on the hypervisor.
May 14 03:43:04.355999 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:04.492255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:04.493369 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0da72fae-0b51-4779-9fd0-6af048d84be6 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.557s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:04.546671 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event volume-extended-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:04.599990 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:43:04.603732 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:43:04.603732 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:04.603732 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:04.643065 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:04.644500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:04.644500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:04.644500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:04.644500 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] No waiting events found dispatching network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:04.644500 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-33580b91-7997-4821-a377-56377c268d39 req-1eadc809-f8db-432d-9786-c1585c93fe2c service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received unexpected event network-vif-plugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 for instance with vm_state active and task_state None.
May 14 03:43:04.683351 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:43:04.842479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:04.844752 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730184.8441625, d734a321-467c-4d7c-b131-a507b95c1f0e => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:04.844752 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] VM Resumed (Lifecycle Event)
May 14 03:43:04.866719 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Took 13.89 seconds to build instance.
May 14 03:43:05.051865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Handling volume-extended event for volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf {{(pid=97948) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 14 03:43:05.104394 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:43:05.212989 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Successfully created port: 6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:43:05.347113 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:05.349973 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:05.366717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.411s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:05.557710 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Cinder extended volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf; extending it to detect new size
May 14 03:43:05.607900 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:43:05.775689 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Successfully updated port: 6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:43:05.995046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:05.995396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:05.995658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:05.995827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:05.995988 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:05.998291 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Terminating instance
May 14 03:43:06.098300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] calling os-brick to extend iSCSI Volume {{(pid=97948) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 14 03:43:06.098651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}), 'kwargs': {}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:06.098832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:06.099318 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:06.099615 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}
May 14 03:43:06.099749 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Multipath discovery for iSCSI enabled
May 14 03:43:06.099965 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0']
May 14 03:43:06.100110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0'] {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 14 03:43:06.114078 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Booting with volume 77c23625-bf8d-422a-8094-368336e78435 at /dev/vda
May 14 03:43:06.118323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0'] {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 14 03:43:06.118561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Running cmd (subprocess): lsscsi {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:06.171976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] CMD "lsscsi" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:06.172357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97948) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 14 03:43:06.172536 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 14 03:43:06.182564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Starting size: 1073741824 {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 14 03:43:06.185529 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:06.201802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:43:06.207377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] volume size after scsi device rescan 2147483648 {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 14 03:43:06.207626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Running cmd (subprocess): lsscsi {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:06.235156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:06.254840 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] CMD "lsscsi" returned: 0 in 0.046s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:06.255701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97948) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 14 03:43:06.255936 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 14 03:43:06.265523 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Starting size: 1073741824 {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 14 03:43:06.281957 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:06.281957 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:06.281957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:06.283788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:43:06.284231 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:43:06.298982 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:43:06.300663 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe12:87b4', 'fe80::68d4:c9ff:fefa:f980', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe00:921c', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe4e:26ed', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:feb5:c5f9', 'fe80::a40d:d8ff:fedd:bd7e', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fe3f:cf79'] 
May 14 03:43:06.300807 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:43:06.300925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:43:06.301622 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:06.302129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] volume size after scsi device rescan 2147483648 {{(pid=97948) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 14 03:43:06.302402 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updating existing volume attachment record: 34bf274b-280f-476c-abcd-8dda8dce196d {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:43:06.314785 np0000000741 nova-compute[97948]: INFO os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Find Multipath device file for volume WWN 330000000cc310996
May 14 03:43:06.315200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000cc310996 exists yet. {{(pid=97948) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 14 03:43:06.315373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] /dev/disk/by-id/dm-uuid-mpath-330000000cc310996 has shown up. {{(pid=97948) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 14 03:43:06.339767 np0000000741 nova-compute[97948]: INFO os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000cc310996) current size 1073741824
May 14 03:43:06.389215 np0000000741 nova-compute[97948]: INFO os_brick.initiator.linuxscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000cc310996) new size 2147483648
May 14 03:43:06.389516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.290s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:06.389676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] <== extend_volume: return (290ms) 2147483648 {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:06.389837 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Extend iSCSI Volume: new_size=2147483648 {{(pid=97948) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 14 03:43:06.394420 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [req-adc3c480-9ce6-4b8f-b636-4f4c6341ef12 req-d8a6c9ac-5ef6-4d3b-9f19-738ab3f733b7 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Resizing target device /dev/dm-6 to 2147483648 {{(pid=97948) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 14 03:43:06.501888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:06.528299 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:06.552535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:06.673335 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:06.680261 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:06.731443 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-changed-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:06.731604 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Refreshing instance network info cache due to event network-changed-6abf4349-a3fd-4067-924e-72e88666c56f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:06.731784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Acquiring lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:06.838348 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999627674000294 future=<Future at 0x79d0b00a9a30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:06.838755 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999285722999957 future=<Future at 0x79d0b00a9a30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:06.841108 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99683027500032 future=<Future at 0x79d0b00a9a30 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:06.842051 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Instance destroyed successfully.
May 14 03:43:06.842196 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lazy-loading 'resources' on Instance uuid d734a321-467c-4d7c-b131-a507b95c1f0e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:06.875245 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:07.051720 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:07.179839 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updating instance_info_cache with network_info: [{"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:07.344602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:07.344602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:07.347459 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-993909987',display_name='tempest-ServersNegativeTestJSON-server-993909987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-993909987',id=47,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:04Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-70gy7g0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:04Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=d734a321-467c-4d7c-b131-a507b95c1f0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:07.347662 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "address": "fa:16:3e:3f:cf:79", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccf15eb-91", "ovs_interfaceid": "5ccf15eb-9136-4193-9f0d-cdd668e0e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:07.350918 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:07.351208 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:07.352718 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.353086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccf15eb-91, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:07.354269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.355274 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:07.356165 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.357380 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.357548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4284a679-b24e-4eeb-a021-a1a522f55435) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:07.358116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.358596 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:07.359181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:07.360760 np0000000741 nova-compute[97948]: INFO os_vif [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cf:79,bridge_name='br-int',has_traffic_filtering=True,id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccf15eb-91')
May 14 03:43:07.361102 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Deleting instance files /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e_del
May 14 03:43:07.361875 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Deletion of /opt/stack/data/nova/instances/d734a321-467c-4d7c-b131-a507b95c1f0e_del complete
May 14 03:43:07.682027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:07.682370 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Instance network_info: |[{"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:43:07.682868 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Acquired lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:07.683040 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Refreshing network info cache for port 6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:07.849206 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Detaching volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf
May 14 03:43:07.869129 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:43:07.869907 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:07.870258 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:07.870381 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:07.870624 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:07.889766 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Attempting to driver detach volume 6e6f3018-fc2f-436e-be2f-5dd1b35b43cf from mountpoint /dev/vdb
May 14 03:43:07.899678 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Found disk vdb by alias ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:43:07.903535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Found disk vdb by alias ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:43:07.903920 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Attempting to detach device vdb from instance b4494ccc-44c6-427e-b6fb-8223b02e60de from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:43:07.904307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <alias name="ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf"/>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <serial>6e6f3018-fc2f-436e-be2f-5dd1b35b43cf</serial>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:07.904307 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:43:07.911150 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Successfully detached device vdb from instance b4494ccc-44c6-427e-b6fb-8223b02e60de from the persistent domain config.
May 14 03:43:07.911359 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] (1/8): Attempting to detach device vdb with device alias ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf from instance b4494ccc-44c6-427e-b6fb-8223b02e60de from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:43:07.911585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <alias name="ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf"/>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <serial>6e6f3018-fc2f-436e-be2f-5dd1b35b43cf</serial>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:07.911585 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:43:07.988735 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:08.185954 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:08.352235 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f400cd4d-6793-4bb2-a166-e14b42d884d9 req-3ddba00f-f1c5-47fb-9d26-571c8ea7f85e service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-deleted-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:08.354025 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-f400cd4d-6793-4bb2-a166-e14b42d884d9 req-3ddba00f-f1c5-47fb-9d26-571c8ea7f85e service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Neutron deleted interface 5ccf15eb-9136-4193-9f0d-cdd668e0e5f3; detaching it from the instance and deleting it from the info cache
May 14 03:43:08.354221 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f400cd4d-6793-4bb2-a166-e14b42d884d9 req-3ddba00f-f1c5-47fb-9d26-571c8ea7f85e service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:08.421701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:43:08.423905 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:43:08.424250 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Creating image(s)
May 14 03:43:08.424621 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:43:08.425088 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Ensure instance console log exists: /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:43:08.425415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:08.425662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:08.425828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:08.426489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Start _get_guest_xml network_info=[{"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd65b01f4-8363-4e20-806e-71a97008228e', 'attached_at': '', 'detached_at': '', 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'serial': '77c23625-bf8d-422a-8094-368336e78435', 'multiattach': True}, 'boot_index': 0, 'attachment_id': '34bf274b-280f-476c-abcd-8dda8dce196d', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:43:08.434892 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:08.435996 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1529622204', uuid='d65b01f4-8363-4e20-806e-71a97008228e'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730188.4356298) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:43:08.437370 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:43:08.438215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:43:08.439161 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:43:08.439357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:43:08.440216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:43:08.440537 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:43:08.440767 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:43:08.440902 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:43:08.441115 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:43:08.441244 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:43:08.441384 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:43:08.441599 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:43:08.441747 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:43:08.441881 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:43:08.442034 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:43:08.442220 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:43:08.461330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:43:08.461529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:08.461662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:08.461982 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:08.462165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:43:08.476971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:08.477801 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:08.478148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:08.478805 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:08.479015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:08.479218 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:08.490738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:08.490738 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:08.499798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:08.499798 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:08.509464 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435] added
May 14 03:43:08.509464 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:08.509464 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:08.509464 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:08.509464 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:08.509464 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:08.509464 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:08.509738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:08.509815 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:08.509946 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:08.512042 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435] added
May 14 03:43:08.512042 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:08.512042 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:08.512042 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:08.512042 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:08.512042 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:08.512042 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:08.512173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:08.512326 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:08.512465 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:08.529280 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730188.5289333, b4494ccc-44c6-427e-b6fb-8223b02e60de => ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:43:08.530726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf for instance b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:43:08.532803 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Successfully detached device vdb from instance b4494ccc-44c6-427e-b6fb-8223b02e60de from the live domain config.
May 14 03:43:08.533809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:43:08.534081 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:08.534197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:08.573532 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:08.705964 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updated VIF entry in instance network info cache for port 6abf4349-a3fd-4067-924e-72e88666c56f. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:43:08.706562 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updating instance_info_cache with network_info: [{"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:08.714057 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:08.755287 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:08.802477 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:08.802786 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:08.803396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:08.803396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:08.803396 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] No waiting events found dispatching network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:08.803396 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0f3d0023-1903-4697-90b9-09e5d69e9647 req-17553ca9-a952-4b0a-babe-d10e10d52120 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:08.858405 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f400cd4d-6793-4bb2-a166-e14b42d884d9 req-3ddba00f-f1c5-47fb-9d26-571c8ea7f85e service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Detach interface failed, port_id=5ccf15eb-9136-4193-9f0d-cdd668e0e5f3, reason: Instance d734a321-467c-4d7c-b131-a507b95c1f0e could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:43:08.970987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:08.971226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:08.971342 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Shelve offloading
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Releasing lock "refresh_cache-d65b01f4-8363-4e20-806e-71a97008228e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Acquiring lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] No waiting events found dispatching network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:09.210282 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-08313edd-3120-49ec-920e-cbf10e5a169e req-9419bd0b-c74f-46a7-a54e-15196041cba4 service nova] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Received event network-vif-unplugged-5ccf15eb-9136-4193-9f0d-cdd668e0e5f3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:09.257614 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Took 1.39 seconds to deallocate network for instance.
May 14 03:43:09.510407 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:09.513019 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:09.522672 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:09.522672 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:09.530220 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:09.530220 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.535606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.542108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.553487 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.554001 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.560281 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.560559 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:09.593581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.40.100,3260]
May 14 03:43:09.593581 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.40.100,3260] successful.
May 14 03:43:09.593581 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.605552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.50.100,3260]
May 14 03:43:09.605552 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.50.100,3260] successful.
May 14 03:43:09.605552 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.607030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.620511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.630605 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.631080 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:09.631080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:09.631899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('13', '-', '-', 0) found on session 116 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:09.632010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.641476 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:09.641826 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:09.641826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:09.642057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:09.642731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('14', '-', '-', 0) found on session 117 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:09.642792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:09.649002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 116 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:09.650560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:09.659629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 117 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:09.659629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:09.767818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:09.767818 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:10.000840 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:10.008358 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:10.030440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:10.056371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:10.231937 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:10.231937 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:10.279826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:10.303786 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999711758000103 future=<Future at 0x79d0b01e92e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:10.308839 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance destroyed successfully.
May 14 03:43:10.309226 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'numa_topology' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:10.450571 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:10.450773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:10.451013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:10.451166 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:10.451565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:10.451751 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received unexpected event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with vm_state active and task_state shelving.
May 14 03:43:10.451901 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:10.452090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:10.452270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:10.452578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:10.453186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:10.453186 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b0687d71-b162-4661-bd5d-29da2f7e9324 req-e8bd341e-efca-41ab-ac98-0e3c2b73a089 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received unexpected event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with vm_state active and task_state shelving.
May 14 03:43:10.478456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:43:10.735685 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:10.813401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:10.815218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:10.815304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:10.815429 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:11.247361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.480s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:11.302618 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Deleted allocations for instance d734a321-467c-4d7c-b131-a507b95c1f0e
May 14 03:43:11.317455 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:11.497710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 3300000006f3df236 for multipath device dm-7 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:43:11.498031 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:11.498187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000006f3df236', 'path': '/dev/dm-7', 'multipath_id': '3300000006f3df236'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:11.498300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f3df236', 'path': '/dev/dm-7', 'multipath_id': '3300000006f3df236'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:43:11.498789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.964s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:11.499104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:43:11.499224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:11.526895 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:11.527269 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:43:11.527269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', '114')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:11.528555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf', '115')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:11.529400 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c4680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:43:11.529555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:43:11.529843 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Flush multipath device 330000000cc310996 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:43:11.560006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:11.614556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:11.659792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:43:11.659792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:43:11.659792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:43:11.672075 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:43:11.673007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:43:11.674827 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:11.684902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.716654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.40.100,3260]
May 14 03:43:11.716654 np0000000741 nova-compute[97948]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.40.100,3260] successful.
May 14 03:43:11.716654 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.735733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.754488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.785701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.50.100,3260]
May 14 03:43:11.785701 np0000000741 nova-compute[97948]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-6e6f3018-fc2f-436e-be2f-5dd1b35b43cf, portal: 192.168.50.100,3260] successful.
May 14 03:43:11.785701 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.804291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:11.804537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:11.804675 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] <== disconnect_volume: return (3269ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:11.804847 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:43:11.819707 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:12.013511 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1529622204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1529622204',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-2565mqvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:06Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=d65b01f4-8363-4e20-806e-71a97008228e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:43:12.013796 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:12.014369 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:12.015056 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid d65b01f4-8363-4e20-806e-71a97008228e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:12.315735 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1dfa41f2-28ae-472f-b135-e521200d77e4 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "d734a321-467c-4d7c-b131-a507b95c1f0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.320s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:12.318970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:12.319250 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:12.319469 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:12.360184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.373255 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lazy-loading 'flavor' on Instance uuid b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:12.517915 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] End _get_guest_xml xml=<domain type="qemu">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <uuid>d65b01f4-8363-4e20-806e-71a97008228e</uuid>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <name>instance-00000030</name>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1529622204</nova:name>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:43:08</nova:creationTime>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         <nova:port uuid="6abf4349-a3fd-4067-924e-72e88666c56f">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <system>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="serial">d65b01f4-8363-4e20-806e-71a97008228e</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="uuid">d65b01f4-8363-4e20-806e-71a97008228e</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </system>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <os>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </os>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <features>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </features>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   <devices>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/disk.config"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <alias name="ua-77c23625-bf8d-422a-8094-368336e78435"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-7"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <serial>77c23625-bf8d-422a-8094-368336e78435</serial>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <shareable/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:c1:d7:44"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <target dev="tap6abf4349-a3"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </interface>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/console.log" append="off"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </serial>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <video>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </video>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </rng>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:   </devices>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]: </domain>
May 14 03:43:12.517915 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:43:12.520161 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Preparing to wait for external event network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:43:12.520161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:12.520161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:12.520768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:12.524188 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1529622204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1529622204',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-2565mqvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:06Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=d65b01f4-8363-4e20-806e-71a97008228e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:43:12.524370 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:12.525818 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:12.525818 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:43:12.526010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.526098 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:12.526289 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:43:12.529677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.529677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '360e0ba2-f33a-5795-84fd-5b4971c3a191', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:12.529677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.530256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:12.535678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.537750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.537955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abf4349-a3, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:12.538264 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abf4349-a3, col_values=(('qos', UUID('585c2e0c-db82-49f5-8ed3-849c1e14daba')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:12.538475 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abf4349-a3, col_values=(('external_ids', {'iface-id': '6abf4349-a3fd-4067-924e-72e88666c56f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:d7:44', 'vm-uuid': 'd65b01f4-8363-4e20-806e-71a97008228e'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:12.539292 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.540417 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:12.553063 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:12.553929 np0000000741 nova-compute[97948]: INFO os_vif [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3')
May 14 03:43:12.782821 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance destroyed successfully.
May 14 03:43:12.783274 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'resources' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:12.844341 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:12.845033 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing instance network info cache due to event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:12.845223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:12.847303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:12.847605 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:13.285046 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Object Instance<41fa8526-521c-46aa-af0a-434ff652136e> lazy-loaded attributes: numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:13.285902 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJAaEb7Aw5VXcLzpycVxwcd9o6oTebKWtAqPywhgNRIKAuhok5gdAzse7ORV5yUZmEfupQHP2692VEepEaLPgHQjPHZHgUD/KYqX3LZ90R24RRJ2UgPQFwLTmxG/HKGwg==',key_name='tempest-TestShelveInstance-1074333860',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:28Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:29Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:13.286149 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:13.286622 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:13.286847 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:13.287732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.287961 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbee297ca-95, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:13.289020 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.290148 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:13.296416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.297444 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.297621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e17bd0bb-6de3-43f8-b44b-1b41fe453fcb) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:13.298197 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.298793 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:13.304613 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.306805 np0000000741 nova-compute[97948]: INFO os_vif [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95')
May 14 03:43:13.308059 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:43:13.308351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:13.308489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:13.308858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:13.309198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:43:13.309346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:13.334181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:13.334792 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:43:13.334792 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '111')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:13.335307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '110')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:13.336003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b02218a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'): ({'sdb'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:43:13.336164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:43:13.336561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flush multipath device 33000000081858413 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:43:13.349942 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:13.386973 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-91912cec-baa5-4156-9a12-9fadcf00b50d tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.042s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:13.393972 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:13.438574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:13.481025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:43:13.481246 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:43:13.482250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:43:13.496249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:43:13.496418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:43:13.511071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.544064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260]
May 14 03:43:13.544064 np0000000741 nova-compute[97948]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260] successful.
May 14 03:43:13.544064 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.558269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.571176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.599796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260]
May 14 03:43:13.599796 np0000000741 nova-compute[97948]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260] successful.
May 14 03:43:13.599796 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.613165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:13.613420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:13.613537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== disconnect_volume: return (304ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:13.613698 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:43:13.614140 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deleting instance files /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e_del
May 14 03:43:13.614596 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deletion of /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e_del complete
May 14 03:43:13.689164 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:13.689396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:13.689615 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:13.689817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:13.689980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:13.692349 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Terminating instance
May 14 03:43:13.718481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:13.742957 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:13.876354 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updated VIF entry in instance network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:43:13.876613 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": null, "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbee297ca-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:14.073970 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:14.076080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:14.076080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:c1:d7:44, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:14.076080 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Using config drive
May 14 03:43:14.195909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:14.223767 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.227187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.251222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.261085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.296190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.297522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:14.378449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8f7bdfbb-9d49-4d4a-b33b-8c2071fb4c2a req-5e0627b6-84e5-456b-b376-da4299a2b627 service nova] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:14.436569 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:14.436799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:14.438802 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:14.439046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:14.439101 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] No waiting events found dispatching network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:14.439763 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-48172d2b-0fad-404e-8871-2441ace6e926 req-d1c13edc-b4ac-4b1d-a0c0-2100079d2d48 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:14.556110 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999668087999908 future=<Future at 0x79d0b00ab980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:14.558251 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Instance destroyed successfully.
May 14 03:43:14.558630 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lazy-loading 'resources' on Instance uuid b4494ccc-44c6-427e-b6fb-8223b02e60de {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:14.580677 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:14.752043 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Creating config drive at /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/disk.config
May 14 03:43:14.757982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4tvqz1ky {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:14.815394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4tvqz1ky" returned: 0 in 0.057s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:15.067989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-112623874',display_name='tempest-VolumesExtendAttachedTest-instance-112623874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesextendattachedtest-instance-112623874',id=42,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+6PjmoBUPYcyemqkF9mlaAMeTKV7+u5gcNGJf3nPne1yQE4Dd+7vi+z274QfcqJb6U5MRNGKQXmDIRXeNBzydkh+AxJAUSUFXgEtZgolG4MNwdLIPYAYDdCczGSYJt7Q==',key_name='tempest-keypair-1132758243',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:16Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e07892e98c064e25b4a6a9069fa574e7',ramdisk_id='',reservation_id='r-ki4fx1ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-32155928',owner_user_name='tempest-VolumesExtendAttachedTest-32155928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b9b5ad65f04a5c92c310335f9d4115',uuid=b4494ccc-44c6-427e-b6fb-8223b02e60de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:15.068317 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converting VIF {"id": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "address": "fa:16:3e:12:87:b4", "network": {"id": "e117e04c-894e-4a57-bd14-f97b88e998b8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-224975165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e07892e98c064e25b4a6a9069fa574e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap993f62e1-1c", "ovs_interfaceid": "993f62e1-1c92-4ac3-9f54-b5a02743d55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:15.069080 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:15.069371 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:15.076441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.076892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap993f62e1-1c, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:15.097649 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.098754 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:15.106617 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.108071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.108314 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbf38c05-96cc-4ebd-9f4b-d418b292228c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:15.109412 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.110205 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:15.116450 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.118966 np0000000741 nova-compute[97948]: INFO os_vif [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:87:b4,bridge_name='br-int',has_traffic_filtering=True,id=993f62e1-1c92-4ac3-9f54-b5a02743d55b,network=Network(e117e04c-894e-4a57-bd14-f97b88e998b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993f62e1-1c')
May 14 03:43:15.118966 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Deleting instance files /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de_del
May 14 03:43:15.119453 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Deletion of /opt/stack/data/nova/instances/b4494ccc-44c6-427e-b6fb-8223b02e60de_del complete
May 14 03:43:15.231939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.263420 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.325215 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Deleted allocations for instance 41fa8526-521c-46aa-af0a-434ff652136e
May 14 03:43:15.366725 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.570521 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.574859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.575939 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.598603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:15.630743 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Took 1.43 seconds to destroy the instance on the hypervisor.
May 14 03:43:15.632579 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:15.633014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:15.633236 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:15.633630 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:15.773154 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:15.836676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:15.836676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:16.151233 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730196.1507213, d65b01f4-8363-4e20-806e-71a97008228e => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:16.151311 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] VM Started (Lifecycle Event)
May 14 03:43:16.243265 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:16.243523 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:16.364707 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a90d46b4-4155-4e4b-99b6-4186849ff44c req-7f228b97-b1b4-4d61-8703-f4eb11dd9b15 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-deleted-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:16.364879 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-a90d46b4-4155-4e4b-99b6-4186849ff44c req-7f228b97-b1b4-4d61-8703-f4eb11dd9b15 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Neutron deleted interface 993f62e1-1c92-4ac3-9f54-b5a02743d55b; detaching it from the instance and deleting it from the info cache
May 14 03:43:16.366484 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a90d46b4-4155-4e4b-99b6-4186849ff44c req-7f228b97-b1b4-4d61-8703-f4eb11dd9b15 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:16.513693 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:16.514377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Acquiring lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:16.514493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:16.514619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:16.514733 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] No waiting events found dispatching network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:16.514794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Received event network-vif-unplugged-993f62e1-1c92-4ac3-9f54-b5a02743d55b for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:16.514905 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:16.515010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:16.515148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:16.515234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:16.515338 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Processing event network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:16.515474 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:16.515618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:16.515694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:16.515792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:16.515898 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] No waiting events found dispatching network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:16.516007 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-40418031-f852-486b-a193-6d7d667e3b3d req-df71388d-9634-4228-bfb4-e7383a672dde service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received unexpected event network-vif-plugged-6abf4349-a3fd-4067-924e-72e88666c56f for instance with vm_state building and task_state spawning.
May 14 03:43:16.516449 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:16.519549 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:16.530053 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Instance spawned successfully.
May 14 03:43:16.530053 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:43:16.653975 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:16.655821 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:16.746726 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:16.808077 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:16.870068 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a90d46b4-4155-4e4b-99b6-4186849ff44c req-7f228b97-b1b4-4d61-8703-f4eb11dd9b15 service nova] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Detach interface failed, port_id=993f62e1-1c92-4ac3-9f54-b5a02743d55b, reason: Instance b4494ccc-44c6-427e-b6fb-8223b02e60de could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:43:17.034878 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.035183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.035888 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.036202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.036588 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.037054 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:17.157915 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:43:17.158163 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730197.1579647, d65b01f4-8363-4e20-806e-71a97008228e => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:17.158316 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] VM Paused (Lifecycle Event)
May 14 03:43:17.254062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.418s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:17.310059 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Took 1.68 seconds to deallocate network for instance.
May 14 03:43:17.456898 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:17.544088 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Took 9.12 seconds to spawn the instance on the hypervisor.
May 14 03:43:17.544234 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:17.660580 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:17.662777 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730197.6624672, d65b01f4-8363-4e20-806e-71a97008228e => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:17.662923 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] VM Resumed (Lifecycle Event)
May 14 03:43:17.764041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b9a3b7e-1eaf-419f-ad29-0365351999bd tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.793s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:17.766571 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.308s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:17.766759 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Unshelving
May 14 03:43:17.816437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:17.816598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:18.060327 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Took 16.58 seconds to build instance.
May 14 03:43:18.165670 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:18.169555 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:18.191768 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:18.191957 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:18.562468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.085s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:18.694963 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:18.724341 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:18.774678 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Booting with volume fcc626a8-7b3a-4876-81c5-83430f2b8fd3 at /dev/vda
May 14 03:43:18.843585 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:18.864517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:43:18.895213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:18.942814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:43:18.943055 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:43:18.952332 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:43:18.954329 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe00:921c', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe4e:26ed', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:feb5:c5f9', 'fe80::a40d:d8ff:fedd:bd7e', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5'] 
May 14 03:43:18.954509 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:43:18.954699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:43:18.955059 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:18.955442 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating existing volume attachment record: 5500ed36-39b4-4406-a2e9-ea87ad4015e9 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:43:19.194998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:19.195311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:19.195540 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:19.198988 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97948) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 03:43:19.199651 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'flavor' on Instance uuid 54f086cf-6a24-4d22-89e8-6aa82dd7f22c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:19.206084 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.389s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:19.268737 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Deleted allocations for instance b4494ccc-44c6-427e-b6fb-8223b02e60de
May 14 03:43:19.335788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:19.336030 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:19.336281 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:19.336450 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:19.336621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:19.339614 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Terminating instance
May 14 03:43:19.843256 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:19.864204 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:19.867967 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:19.882933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:19.905687 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:19.927658 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:19.935430 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.027202 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:20.028767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:20.028767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:20.029016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:20.030165 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] No waiting events found dispatching network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:20.030674 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a0de94b2-0297-43c8-98f0-09aced96b5e6 req-962c0f26-d217-4b12-bb4c-f97dc4210704 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:20.110244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.198130 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99966397099979 future=<Future at 0x79d0b0417d40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:20.203541 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Instance destroyed successfully.
May 14 03:43:20.204105 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lazy-loading 'resources' on Instance uuid bf111060-82e6-4fb4-84c4-262006fd00a0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:20.244090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.268369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.271552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.279917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-dc6e7bfd-bf82-405b-8cb9-f81f824533d3 tempest-VolumesExtendAttachedTest-32155928 tempest-VolumesExtendAttachedTest-32155928-project-member] Lock "b4494ccc-44c6-427e-b6fb-8223b02e60de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.590s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:20.301595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.559502 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999668307999855 future=<Future at 0x79d0b01b0560 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:20.562186 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance destroyed successfully.
May 14 03:43:20.563933 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'numa_topology' on Instance uuid 54f086cf-6a24-4d22-89e8-6aa82dd7f22c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:20.644381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:20.644652 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:20.646600 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'pci_requests' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:20.707124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191634951',display_name='tempest-ServersNegativeTestJSON-server-1191634951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-serversnegativetestjson-server-1191634951',id=46,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:47Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f65182d1764eb393e98fdd7d875119',ramdisk_id='',reservation_id='r-8l70hd6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1531732290',owner_user_name='tempest-ServersNegativeTestJSON-1531732290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:48Z,user_data=None,user_id='70bcb0ef074342f2830dfda55709c99e',uuid=bf111060-82e6-4fb4-84c4-262006fd00a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:20.707343 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converting VIF {"id": "dcfb67a9-9969-4652-828e-ee5420d6b500", "address": "fa:16:3e:b5:c5:f9", "network": {"id": "8fbcd895-bab9-469a-aaf8-6da8a04be079", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-584877812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f65182d1764eb393e98fdd7d875119", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfb67a9-99", "ovs_interfaceid": "dcfb67a9-9969-4652-828e-ee5420d6b500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:20.707880 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:20.708122 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:20.709288 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.709605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcfb67a9-99, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:20.711288 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.711896 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:20.718006 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.722278 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.723010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7473dfd2-9c2b-4dec-a748-fee01c25b627) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:20.724754 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.724754 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:20.731431 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:20.734295 np0000000741 nova-compute[97948]: INFO os_vif [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=dcfb67a9-9969-4652-828e-ee5420d6b500,network=Network(8fbcd895-bab9-469a-aaf8-6da8a04be079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfb67a9-99')
May 14 03:43:20.734581 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Deleting instance files /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0_del
May 14 03:43:20.735231 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Deletion of /opt/stack/data/nova/instances/bf111060-82e6-4fb4-84c4-262006fd00a0_del complete
May 14 03:43:20.760342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:20.760342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:21.066505 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<54f086cf-6a24-4d22-89e8-6aa82dd7f22c> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:21.066906 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:21.150010 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'numa_topology' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:21.240974 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 03:43:21.241573 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:21.244004 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:21.244118 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:21.244393 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:21.263566 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:43:21.347953 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:21.578416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a35d16fa-fa3d-4906-b260-894ef08dad0a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.383s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:21.636158 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-370f3027-2073-4e87-a0ff-24341f9a9f73 req-2842e96b-a52e-4a21-aae6-f1bebb612d81 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-deleted-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:21.636347 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-370f3027-2073-4e87-a0ff-24341f9a9f73 req-2842e96b-a52e-4a21-aae6-f1bebb612d81 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Neutron deleted interface dcfb67a9-9969-4652-828e-ee5420d6b500; detaching it from the instance and deleting it from the info cache
May 14 03:43:21.636507 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-370f3027-2073-4e87-a0ff-24341f9a9f73 req-2842e96b-a52e-4a21-aae6-f1bebb612d81 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:21.651968 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:21.652338 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Claim successful on node np0000000741
May 14 03:43:21.819995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:21.838400 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00042286300003979704 future=<Future at 0x79d0b00a9a30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:21.839002 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730186.837849, d734a321-467c-4d7c-b131-a507b95c1f0e => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:21.839190 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:21.839378 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] VM Stopped (Lifecycle Event)
May 14 03:43:21.840795 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.4626827070001127 future=<Future at 0x79d0b01e92e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:21.841941 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.4620055179998417 future=<Future at 0x79d0b01e92e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:22.073460 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:22.090751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:22.091455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Acquiring lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:22.091688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:22.091881 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:22.092066 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] No waiting events found dispatching network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:22.092224 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Received event network-vif-unplugged-dcfb67a9-9969-4652-828e-ee5420d6b500 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:22.092391 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:22.092564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:22.092784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:22.092937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:22.093131 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] No waiting events found dispatching network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:22.093221 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received unexpected event network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb for instance with vm_state stopped and task_state None.
May 14 03:43:22.093321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:22.093759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:22.093977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:22.094169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:22.094347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] No waiting events found dispatching network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:22.094545 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-aefbcb18-7dd2-4f3e-a870-5a36aa224ee4 req-f35fd183-996a-446e-b4a0-a9c44aeaf59c service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received unexpected event network-vif-unplugged-283716d9-85e9-4424-ba78-042e2c2365eb for instance with vm_state stopped and task_state None.
May 14 03:43:22.140887 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-370f3027-2073-4e87-a0ff-24341f9a9f73 req-2842e96b-a52e-4a21-aae6-f1bebb612d81 service nova] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Detach interface failed, port_id=dcfb67a9-9969-4652-828e-ee5420d6b500, reason: Instance bf111060-82e6-4fb4-84c4-262006fd00a0 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:43:22.342180 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: d734a321-467c-4d7c-b131-a507b95c1f0e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:22.577062 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Took 1.33 seconds to deallocate network for instance.
May 14 03:43:23.024263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:23.024458 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:23.091347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:23.402790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:23.527116 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:23.722761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:24.033279 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.389s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:24.035918 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:24.036140 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.214s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:24.042670 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:24.042670 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Claim successful on node np0000000741
May 14 03:43:24.104458 np0000000741 nova-compute[97948]: INFO nova.network.neutron [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating port bee297ca-9526-4351-9c29-e8c837c03eef with attributes {'binding:host_id': 'np0000000741', 'device_owner': 'compute:nova'}
May 14 03:43:24.676187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:24.676187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:24.676187 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:24.759100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:24.759371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:24.804720 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:24.804889 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing instance network info cache due to event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:24.805057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:25.179948 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:25.265860 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00044547600009536836 future=<Future at 0x79d0b01e92e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730190.3034027, 41fa8526-521c-46aa-af0a-434ff652136e => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Stopped (Lifecycle Event)
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.249733582999852 future=<Future at 0x79d0b00ab980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:25.308293 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=4.249573177000002 future=<Future at 0x79d0b00ab980 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:25.308751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:25.395837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:25.397664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:25.397664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:25.397664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:25.397664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:25.398655 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Terminating instance
May 14 03:43:25.527158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:25.527346 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:25.577515 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:25.723172 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:25.724299 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:25.807544 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10faad34-a93a-4be2-9a3d-a631a4820bb0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:25.902846 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:25.906822 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Instance destroyed successfully.
May 14 03:43:25.907786 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid 54f086cf-6a24-4d22-89e8-6aa82dd7f22c {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:26.031316 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:26.225485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:26.226351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:43:26.226575 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:26.227083 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating image(s)
May 14 03:43:26.227227 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:26.228120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:43:26.228256 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Ensure instance console log exists: /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:43:26.228565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:26.228828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:26.228939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:26.229266 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start _get_guest_xml network_info=[{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '41fa8526-521c-46aa-af0a-434ff652136e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'serial': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3'}, 'boot_index': 0, 'attachment_id': '5500ed36-39b4-4406-a2e9-ea87ad4015e9', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:43:26.231311 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:26.232163 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-529657334', uuid='41fa8526-521c-46aa-af0a-434ff652136e'), owner=OwnerMeta(userid='33d5d5f4d4d84196956203afe36f6d37', username='tempest-TestShelveInstance-1690582218-project-member', projectid='881e23fb403045d89cc278cce41eb2a5', projectname='tempest-TestShelveInstance-1690582218'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730206.2319229) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:43:26.232996 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:43:26.233301 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:43:26.234395 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:43:26.234600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:43:26.235384 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:43:26.235649 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:43:26.235840 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:43:26.235959 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:43:26.236098 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:43:26.236212 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:43:26.236335 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:43:26.236499 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:43:26.236745 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:43:26.236889 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:43:26.237000 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:43:26.237106 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:43:26.237228 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:26.270956 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:26.409522 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1572383328',display_name='tempest-TestVolumeBootPattern-server-1572383328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1572383328',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDbJWInBw2xGvOAdnEdfp19d1MX8zJAaIkkY47pTgTlSD0egqP9F0jdWkgT4bcvWpZ3Cr81LTZrmn2WiwgzR0TiMiyNaQLfQTPTynXBp9dSGStMzi6hwy4yuvEaP9ViUQ==',key_name='tempest-keypair-467670933',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:36Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-z42f3ec0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=54f086cf-6a24-4d22-89e8-6aa82dd7f22c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:26.409740 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "283716d9-85e9-4424-ba78-042e2c2365eb", "address": "fa:16:3e:00:92:1c", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283716d9-85", "ovs_interfaceid": "283716d9-85e9-4424-ba78-042e2c2365eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:26.410301 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:26.410541 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:26.411862 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:26.412146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap283716d9-85, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:26.413457 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:26.415370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:26.415370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:26.415878 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ed62de3-7a90-4f40-887a-6d66484fa886) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:26.416494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:26.417574 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:26.419694 np0000000741 nova-compute[97948]: INFO os_vif [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:92:1c,bridge_name='br-int',has_traffic_filtering=True,id=283716d9-85e9-4424-ba78-042e2c2365eb,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283716d9-85')
May 14 03:43:26.422258 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:43:26.422258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:26.422258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:26.422258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:26.422258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:43:26.422547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:43:26.446714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:26.446714 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:26.446714 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:26.446714 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:26.446714 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:26.446984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:26.446984 np0000000741 nova-compute[97948]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37 (non-flash)
May 14 03:43:26.446984 np0000000741 nova-compute[97948]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:26.446984 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:26.446984 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:26.447124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:43:26.447226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '112')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:26.450815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37', '113')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:26.450815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01ee2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:43:26.450815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:43:26.450815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 33000000094a070ad {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:43:26.514086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:26.541180 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.507s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:26.542025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.450s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:26.542288 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:43:26.569379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:26.622161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:43:26.622161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:43:26.622446 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:43:26.633521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:43:26.634069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:43:26.651614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.677367 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.40.100,3260]
May 14 03:43:26.677367 np0000000741 nova-compute[97948]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.40.100,3260] successful.
May 14 03:43:26.677367 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.690814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.703667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.731501 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:26.733491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.50.100,3260]
May 14 03:43:26.733491 np0000000741 nova-compute[97948]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-5b26d00d-3eeb-4d8d-bd9d-950be5d75e37, portal: 192.168.50.100,3260] successful.
May 14 03:43:26.733491 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.739432 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Object Instance<41fa8526-521c-46aa-af0a-434ff652136e> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:26.747929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.748931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:26.748931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (326ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:26.748931 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:43:26.749055 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Deleting instance files /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c_del
May 14 03:43:26.750723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:43:26.751082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:26.751226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:26.752312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:26.753465 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Deletion of /opt/stack/data/nova/instances/54f086cf-6a24-4d22-89e8-6aa82dd7f22c_del complete
May 14 03:43:26.757462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:43:26.771899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:26.773305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:26.773686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:26.773948 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:26.774260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:26.774469 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:26.789782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:26.789782 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.792038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:26.792038 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.804477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3] added
May 14 03:43:26.804477 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:26.804477 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:26.804477 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:26.804477 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:26.804477 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:26.804477 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.804725 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:26.804894 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:26.805251 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:26.811262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3] added
May 14 03:43:26.811262 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:26.811262 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:26.811262 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:26.811262 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:26.811262 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:26.811262 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:26.811479 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:26.811739 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:26.811901 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:26.860151 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861071 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861071 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861071 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861071 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861265 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:26.861345 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:43:26.861684 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.92 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:43:27.003261 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:27.003441 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:27.051154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:43:27.051318 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:43:27.051510 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:27.051747 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:27.118418 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:27.152407 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:43:27.260840 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:43:27.263902 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:27.263994 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:27.264366 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:27.264366 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:27.287776 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updated VIF entry in instance network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:43:27.287989 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:27.336676 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:27.394479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:27.394765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:27.395007 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Attaching volume ed84f0a7-fcc2-4333-81c3-e484c9a26790 to /dev/vdb
May 14 03:43:27.448002 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:27.459811 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:43:27.487707 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:27.509545 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:27.544105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:43:27.544404 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:43:27.553529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:43:27.556159 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe4e:26ed', 'fe80::e4dc:c1ff:fecd:2ddc', 'fe80::fc16:3eff:feb3:accc', 'fe80::5489:a1ff:fe15:6f48', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5'] 
May 14 03:43:27.556535 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:43:27.561139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:43:27.561269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:43:27.561559 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:27.561875 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating existing volume attachment record: bc5b31c3-704a-494f-81d1-57f250aa0aed {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:43:27.667559 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Successfully created port: 4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:43:27.783393 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:27.784569 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:43:27.791000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7f04d0a6-1aa8-40db-99d2-b8900a347b15 req-f4cfe78e-ba0f-4f08-b10d-e79a74919b36 service nova] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:27.805771 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:27.812309 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:27.822741 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:27.822741 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:27.831710 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:27.831710 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.840319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.855327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.864279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.864279 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.864279 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:27.864279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.864279 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.864279 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:27.875032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.875032 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.875032 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:27.875150 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.875150 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.875150 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:27.905880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260]
May 14 03:43:27.905880 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260] successful.
May 14 03:43:27.905880 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.913143 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260]
May 14 03:43:27.913143 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260] successful.
May 14 03:43:27.913143 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.925621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.931389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:27.941068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.941068 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.941068 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.941068 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.941068 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:27.941215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.941215 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.941215 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.941215 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.941215 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:27.941597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:27.941707 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:27.942322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] HCTL ('7', '-', '-', 0) found on session 118 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:27.942430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:27.949505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.949505 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.949505 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.949505 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.949505 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:27.949803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.949803 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:27.949803 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.949803 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:27.949803 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:27.950156 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:27.950292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:27.952168 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] HCTL ('8', '-', '-', 0) found on session 119 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:27.953008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:27.966116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching for a device in session 118 and hctl ['7', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:27.974026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching for a device in session 119 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:27.974026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:28.022742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.481s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:28.071377 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:43:28.107830 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Deleted allocations for instance bf111060-82e6-4fb4-84c4-262006fd00a0
May 14 03:43:28.141557 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:43:28.147020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7473ded-7d30-4d8f-90b1-85c791193852 req-1f2f713f-9947-4f5d-8edd-1205a3cf03b4 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Received event network-vif-deleted-283716d9-85e9-4424-ba78-042e2c2365eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:28.147716 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-d7473ded-7d30-4d8f-90b1-85c791193852 req-1f2f713f-9947-4f5d-8edd-1205a3cf03b4 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Neutron deleted interface 283716d9-85e9-4424-ba78-042e2c2365eb; detaching it from the instance and deleting it from the info cache
May 14 03:43:28.148299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:28.148842 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d7473ded-7d30-4d8f-90b1-85c791193852 req-1f2f713f-9947-4f5d-8edd-1205a3cf03b4 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:28.149769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:28.291894 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:28.292266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:28.292266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:28.292365 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:43:28.413838 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Successfully updated port: 4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:43:28.450976 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:28.493804 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:28.494449 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing instance network info cache due to event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:28.494591 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] Acquiring lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:28.494726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] Acquired lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:28.494857 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing network info cache for port 4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:28.653684 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d7473ded-7d30-4d8f-90b1-85c791193852 req-1f2f713f-9947-4f5d-8edd-1205a3cf03b4 service nova] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Detach interface failed, port_id=283716d9-85e9-4424-ba78-042e2c2365eb, reason: Instance 54f086cf-6a24-4d22-89e8-6aa82dd7f22c could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:43:28.724122 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:28.926092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:28.952692 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Took 1.69 seconds to deallocate network for instance.
May 14 03:43:28.968544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Searching for a device in session 118 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:28.968777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:28.999356 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:29.083554 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:29.087397 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:43:29.088525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:43:29.089250 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Creating image(s)
May 14 03:43:29.090473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:29.090841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:29.091586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:29.092165 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:29.095560 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:29.096428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.126768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ddf672bf-97c4-494a-b34f-4b0ca19d31b0 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Lock "bf111060-82e6-4fb4-84c4-262006fd00a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.790s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:29.185713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.186204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:29.186566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:29.187011 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:29.190831 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:29.191289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.270380 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:29.286521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.287309 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.327721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.346362 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk 1073741824" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.347311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:29.348007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.436872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.437534 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:43:29.437785 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.448992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.450496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.524346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.524753 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:43:29.525169 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:43:29.525333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Ensure instance console log exists: /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:43:29.525615 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:29.525836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:29.525986 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:29.532532 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Took 0.58 seconds to detach 1 volumes for instance.
May 14 03:43:29.555676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.555988 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00047392799979206757 future=<Future at 0x79d0b00ab980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:29.556062 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:29.556172 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.6413969850000285 future=<Future at 0x79d0b0417d40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:29.556732 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.6413121579998915 future=<Future at 0x79d0b0417d40 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:29.558257 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Emitting event <LifecycleEvent: 1778730194.5554342, b4494ccc-44c6-427e-b6fb-8223b02e60de => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:29.560656 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] VM Stopped (Lifecycle Event)
May 14 03:43:29.565905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.672501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.673284 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.688735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:29.766773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.773213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:43:29.774054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-35689b74-dbf0-4da8-9350-2dc400d4a48a req-3aec116d-457c-4a1b-8484-429df1e462d0 service nova] Releasing lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:29.776683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:29.778160 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:29.786888 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:29.788239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:29.806703 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Found WWN 33000000081858413 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:43:29.809126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:29.809543 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== connect_volume: return (3057ms) {'type': 'block', 'scsi_wwn': '33000000081858413', 'path': '/dev/dm-0', 'multipath_id': '33000000081858413'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:29.810732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000081858413', 'path': '/dev/dm-0', 'multipath_id': '33000000081858413'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:43:29.814764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.665s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:29.814764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:43:29.830068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:29.831195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:29.831811 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:29.832003 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:29.832851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:29.834993 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:29.847863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:29.847863 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:29.848372 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:29.848372 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:29.850232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:29.850729 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13186MB free_disk=73.02115631103516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:43:29.853963 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:29.853963 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:29.861398 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790] added
May 14 03:43:29.861398 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:29.861398 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:29.861398 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:29.861398 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:29.861398 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:29.861398 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:29.861583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:29.861818 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:29.861984 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:29.865929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790] added
May 14 03:43:29.865929 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:29.865929 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:29.865929 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:29.865929 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:29.865929 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:29.865929 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:29.866101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:29.866344 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:29.866422 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:30.040762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:30.066072 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-64a5e4d2-1e37-4435-a089-04ba42409a7e tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: b4494ccc-44c6-427e-b6fb-8223b02e60de] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:30.327628 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1074333860',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:28Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:18Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:43:30.327628 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:30.328174 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:30.328910 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'pci_devices' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:30.402604 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:30.574969 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:30.730767 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:30.831228 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Object Instance<41fa8526-521c-46aa-af0a-434ff652136e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:30.832485 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] End _get_guest_xml xml=<domain type="qemu">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <uuid>41fa8526-521c-46aa-af0a-434ff652136e</uuid>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <name>instance-0000002b</name>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestShelveInstance-server-529657334</nova:name>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:43:26</nova:creationTime>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:user uuid="33d5d5f4d4d84196956203afe36f6d37">tempest-TestShelveInstance-1690582218-project-member</nova:user>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:project uuid="881e23fb403045d89cc278cce41eb2a5">tempest-TestShelveInstance-1690582218</nova:project>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         <nova:port uuid="bee297ca-9526-4351-9c29-e8c837c03eef">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <system>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="serial">41fa8526-521c-46aa-af0a-434ff652136e</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="uuid">41fa8526-521c-46aa-af0a-434ff652136e</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </system>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <os>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </os>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <features>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </features>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   <devices>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <alias name="ua-fcc626a8-7b3a-4876-81c5-83430f2b8fd3"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <serial>fcc626a8-7b3a-4876-81c5-83430f2b8fd3</serial>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:14:69:5e"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <target dev="tapbee297ca-95"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </interface>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/console.log" append="off"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </serial>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <video>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </video>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </rng>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:   </devices>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]: </domain>
May 14 03:43:30.832485 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Preparing to wait for external event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1074333860',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:28Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:18Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:30.835339 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:43:30.838570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:30.838570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:30.838570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:43:30.839596 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:30.840183 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d3cb81d-ae55-5794-b856-2521f5764493', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:30.841493 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:30.844187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:30.846315 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:30.848101 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbee297ca-95, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:30.848101 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbee297ca-95, col_values=(('qos', UUID('bcfa13b5-2b91-4a2d-b3e1-2c0d84ca640b')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:30.848101 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbee297ca-95, col_values=(('external_ids', {'iface-id': 'bee297ca-9526-4351-9c29-e8c837c03eef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:69:5e', 'vm-uuid': '41fa8526-521c-46aa-af0a-434ff652136e'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:30.856350 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:30.857088 np0000000741 nova-compute[97948]: INFO os_vif [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95')
May 14 03:43:30.863666 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:30.866840 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:30.881889 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:30.881889 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:30.889783 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:30.889783 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.898884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.908342 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.917958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.917958 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.917958 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.917958 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.917958 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:30.918127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.918127 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.918127 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.918127 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.918127 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:30.927900 np0000000741 nova-compute[97948]: WARNING nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 54f086cf-6a24-4d22-89e8-6aa82dd7f22c is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. Skipping heal of allocation because we do not know what to do.
May 14 03:43:30.928438 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.928438 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.928438 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.928438 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.928438 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:30.928695 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:43:30.928921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.928921 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:30.928921 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.928921 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:30.928921 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:30.929280 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ce825ac9-1ee3-49dc-8a58-38a9447e8784 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:43:30.929280 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:43:30.929357 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 41fa8526-521c-46aa-af0a-434ff652136e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:43:30.929468 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:43:30.929735 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:43:30.929935 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:43:29 up 35 min,  2 users,  load average: 6.60, 6.87, 4.48\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_bce458cafea74d40af089b430f6b92ce': '1', 'io_workload': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_881e23fb403045d89cc278cce41eb2a5': '1', 'num_proj_61f7491c96154009b61199ad430386d3': '1', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '2', 'num_vm_building': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:43:30.980222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.50.100,3260]
May 14 03:43:30.980222 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.50.100,3260] successful.
May 14 03:43:30.980222 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.981724 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.40.100,3260]
May 14 03:43:30.981724 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.40.100,3260] successful.
May 14 03:43:30.981724 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:30.997435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:31.005519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.018139 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('9', '-', '-', 0) found on session 120 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:31.018139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.025598 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:31.026676 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:31.026942 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.027126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:31.027927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:31.028702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] HCTL ('10', '-', '-', 0) found on session 121 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:31.029104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:31.039341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 120 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:31.039341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:31.046901 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Searching for a device in session 121 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:31.046901 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:31.233903 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:31.234343 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance network_info: |[{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:43:31.236406 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Start _get_guest_xml network_info=[{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:43:31.239737 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:31.240838 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='179fc6e1-dfbb-4b6c-9dc7-9b1113470271'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730211.2404585) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:43:31.241896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:43:31.242408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:43:31.243298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:43:31.243501 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:43:31.244291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:43:31.244620 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:43:31.244777 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:43:31.244882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:43:31.245001 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:43:31.245525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:43:31.245525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:43:31.245525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:43:31.245525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:43:31.245525 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:43:31.245667 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:43:31.245746 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:43:31.256237 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=49,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-73qbfxbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=179fc6e1-dfbb-4b6c-9dc7-9b1113470271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:43:31.256464 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:31.256944 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:31.257420 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:31.317359 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:31.317660 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:31.760002 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] End _get_guest_xml xml=<domain type="qemu">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <uuid>179fc6e1-dfbb-4b6c-9dc7-9b1113470271</uuid>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <name>instance-00000031</name>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-0</nova:name>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:43:31</nova:creationTime>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         <nova:port uuid="4e51b4dc-190b-42e0-95b5-f061b10f594f">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <system>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="serial">179fc6e1-dfbb-4b6c-9dc7-9b1113470271</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="uuid">179fc6e1-dfbb-4b6c-9dc7-9b1113470271</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </system>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <os>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </os>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <features>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </features>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   <devices>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.config"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:92:e4:d2"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <target dev="tap4e51b4dc-19"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </interface>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/console.log" append="off"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </serial>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <video>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </video>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </rng>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:   </devices>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]: </domain>
May 14 03:43:31.760002 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Preparing to wait for external event network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=49,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-73qbfxbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=179fc6e1-dfbb-4b6c-9dc7-9b1113470271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:31.763022 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:43:31.764481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.764481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:31.764481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:43:31.765971 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.766139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26d53090-9390-5070-9477-6b27ff8ced32', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:31.766872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.767439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:31.775905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.778436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.778737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e51b4dc-19, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:31.778927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e51b4dc-19, col_values=(('qos', UUID('856826c0-1531-410a-8599-9625c9eeb32e')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:31.779054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e51b4dc-19, col_values=(('external_ids', {'iface-id': '4e51b4dc-190b-42e0-95b5-f061b10f594f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e4:d2', 'vm-uuid': '179fc6e1-dfbb-4b6c-9dc7-9b1113470271'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:31.780130 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.781466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:31.791186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:31.792137 np0000000741 nova-compute[97948]: INFO os_vif [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19')
May 14 03:43:31.820279 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:31.835593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:43:32.330594 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:43:32.330815 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.480s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:32.331441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.290s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:32.331891 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:43:32.335539 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:32.375233 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:32.375362 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:32.375488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] No VIF found with MAC fa:16:3e:14:69:5e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:32.375918 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Using config drive
May 14 03:43:32.396473 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance 54f086cf-6a24-4d22-89e8-6aa82dd7f22c
May 14 03:43:32.853139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found WWN 3300000003b56b671 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:43:32.853514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:32.853514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== connect_volume: return (4704ms) {'type': 'block', 'scsi_wwn': '3300000003b56b671', 'path': '/dev/dm-3', 'multipath_id': '3300000003b56b671'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:32.853623 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b56b671', 'path': '/dev/dm-3', 'multipath_id': '3300000003b56b671'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:43:32.857182 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:32.881337 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'ec2_ids' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:33.107759 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:33.312791 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:33.312909 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:33.312971 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:92:e4:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:33.315266 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Using config drive
May 14 03:43:33.360278 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Attempting to attach volume ed84f0a7-fcc2-4333-81c3-e484c9a26790 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:43:33.361685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:   <alias name="ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790"/>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:   <serial>ed84f0a7-fcc2-4333-81c3-e484c9a26790</serial>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:33.361685 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:43:33.385821 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Object Instance<41fa8526-521c-46aa-af0a-434ff652136e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:33.386000 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'keypairs' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:33.408288 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45a92771-9336-4942-969f-610657781406 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "54f086cf-6a24-4d22-89e8-6aa82dd7f22c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.012s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:33.725521 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:33.819898 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:33.888578 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Object Instance<41fa8526-521c-46aa-af0a-434ff652136e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:43:33.891768 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:34.024352 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Creating config drive at /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.config
May 14 03:43:34.029564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyqrlqfi8 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:34.057505 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Creating config drive at /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config
May 14 03:43:34.063838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjhdlnr7j {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:34.090899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyqrlqfi8" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:34.123306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjhdlnr7j" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:34.841956 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:34.874884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:34.973048 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.002819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.004857 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.069651 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:35.069844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:35.069967 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:35.070098 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] No VIF found with MAC fa:16:3e:4e:26:ed, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:35.089663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.188651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.191725 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.198173 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000513429999955406 future=<Future at 0x79d0b0417d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.198560 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.198685 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.36045667400003367 future=<Future at 0x79d0b01b0560 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.198798 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.36032983999984936 future=<Future at 0x79d0b01b0560 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.199784 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.201542 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730200.1974862, bf111060-82e6-4fb4-84c4-262006fd00a0 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:35.201773 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] VM Stopped (Lifecycle Event)
May 14 03:43:35.224670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.333573 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2181f1e7-f566-419a-9bcc-f47ed0a908e3 req-9cf9ad2f-82a2-4914-a6a7-8e92e57cada5 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:35.333929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f1e7-f566-419a-9bcc-f47ed0a908e3 req-9cf9ad2f-82a2-4914-a6a7-8e92e57cada5 service nova] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:35.334821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f1e7-f566-419a-9bcc-f47ed0a908e3 req-9cf9ad2f-82a2-4914-a6a7-8e92e57cada5 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:35.335624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f1e7-f566-419a-9bcc-f47ed0a908e3 req-9cf9ad2f-82a2-4914-a6a7-8e92e57cada5 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:35.337737 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2181f1e7-f566-419a-9bcc-f47ed0a908e3 req-9cf9ad2f-82a2-4914-a6a7-8e92e57cada5 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Processing event network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:35.487589 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.488365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:35.560421 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0012374140001156775 future=<Future at 0x79d0b01b0560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.560525 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:35.560902 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730200.5590746, 54f086cf-6a24-4d22-89e8-6aa82dd7f22c => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:35.561076 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] VM Stopped (Lifecycle Event)
May 14 03:43:35.705341 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: bf111060-82e6-4fb4-84c4-262006fd00a0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:35.967816 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730215.9674776, 41fa8526-521c-46aa-af0a-434ff652136e => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:35.968018 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Started (Lifecycle Event)
May 14 03:43:36.064467 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 54f086cf-6a24-4d22-89e8-6aa82dd7f22c] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:36.103506 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:36.106000 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:36.108288 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance spawned successfully.
May 14 03:43:36.108688 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:43:36.474173 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:36.492140 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730216.4895723, 41fa8526-521c-46aa-af0a-434ff652136e => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:36.492140 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Paused (Lifecycle Event)
May 14 03:43:36.535410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:36.535410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:36.535410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:36.535410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:36.535410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:36.540148 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Terminating instance
May 14 03:43:36.562791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:36.614151 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.614266 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.614540 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.614830 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.615079 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.615324 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:36.625953 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-61831448-b16c-40ff-94af-65f9171cebe3 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.231s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:36.782100 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:36.995608 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:37.002702 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:37.044296 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:37.079929 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.104485 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.107042 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.125613 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Took 8.04 seconds to spawn the instance on the hypervisor.
May 14 03:43:37.125801 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:37.139244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.139244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.395457 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Instance destroyed successfully.
May 14 03:43:37.395896 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lazy-loading 'resources' on Instance uuid ce825ac9-1ee3-49dc-8a58-38a9447e8784 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:37.456582 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:37.456889 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:37.457087 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:37.457222 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:37.457378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] No waiting events found dispatching network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:37.457589 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-4fb5d9e9-d446-4604-a496-cca291f9f22a req-aee7b767-5509-4751-8d44-7c02344acc07 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received unexpected event network-vif-plugged-4e51b4dc-190b-42e0-95b5-f061b10f594f for instance with vm_state active and task_state None.
May 14 03:43:37.464871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:37.465027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:37.508828 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:43:37.509093 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730217.5088978, 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:37.509178 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] VM Started (Lifecycle Event)
May 14 03:43:37.635799 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Took 15.87 seconds to build instance.
May 14 03:43:37.898693 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-189719289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumeshelvetestjson-server-189719289',id=40,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYZtmFiHK6KHeFuAXBdI1WJYwmC3qNFD3NJgQvXxS4dGuTlE2O5jKyAEpDeQLiKqZBheLPcFD/jbIXdzA3rtxGl9jDeO1aT+BuENCIc2YdiaqkamwCd3klfiTt7Yw9zQ==',key_name='tempest-keypair-1108094769',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bce458cafea74d40af089b430f6b92ce',ramdisk_id='',reservation_id='r-l05yos3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1886486107',owner_user_name='tempest-AttachVolumeShelveTestJSON-1886486107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755776b8b15e43bbac70f82cfea689e2',uuid=ce825ac9-1ee3-49dc-8a58-38a9447e8784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:37.898924 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converting VIF {"id": "e5556cca-f97d-4076-99f5-69c144e18564", "address": "fa:16:3e:b3:ac:cc", "network": {"id": "de07537d-9b78-4dc1-90e0-963b3720cce1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-294025763-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bce458cafea74d40af089b430f6b92ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5556cca-f9", "ovs_interfaceid": "e5556cca-f97d-4076-99f5-69c144e18564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:37.899554 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:37.899828 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:37.903131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.903471 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5556cca-f9, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:37.904877 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.906552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:37.906907 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.907514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.907628 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=860dfd96-cd6c-49bc-a4a0-684c694a5b8d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:37.908028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.908411 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:37.909434 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:37.912225 np0000000741 nova-compute[97948]: INFO os_vif [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ac:cc,bridge_name='br-int',has_traffic_filtering=True,id=e5556cca-f97d-4076-99f5-69c144e18564,network=Network(de07537d-9b78-4dc1-90e0-963b3720cce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5556cca-f9')
May 14 03:43:37.912542 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Deleting instance files /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784_del
May 14 03:43:37.920851 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Deletion of /opt/stack/data/nova/instances/ce825ac9-1ee3-49dc-8a58-38a9447e8784_del complete
May 14 03:43:37.968196 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Detaching volume ed84f0a7-fcc2-4333-81c3-e484c9a26790
May 14 03:43:38.012964 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:38.017311 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:38.028702 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Attempting to driver detach volume ed84f0a7-fcc2-4333-81c3-e484c9a26790 from mountpoint /dev/vdb
May 14 03:43:38.037260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:43:38.038631 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Found disk vdb by alias ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:43:38.041976 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Attempting to detach device vdb from instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:43:38.042348 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <alias name="ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790"/>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <serial>ed84f0a7-fcc2-4333-81c3-e484c9a26790</serial>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:38.042348 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:43:38.049470 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 from the persistent domain config.
May 14 03:43:38.049677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] (1/8): Attempting to detach device vdb with device alias ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790 from instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:43:38.049996 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <alias name="ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790"/>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-3"/>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <serial>ed84f0a7-fcc2-4333-81c3-e484c9a26790</serial>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]: </disk>
May 14 03:43:38.049996 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:43:38.137337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e9a5a2c2-4241-4a30-bb56-039e012caaea tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.378s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:38.429742 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 03:43:38.429905 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:38.430081 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:38.430234 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:38.430502 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:38.506077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:38.522000 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730218.5215874, 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:38.522207 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] VM Paused (Lifecycle Event)
May 14 03:43:38.542163 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:38.727427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:38.751142 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790 for instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:43:39.026794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:39.032098 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730219.0317247, 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:39.032264 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] VM Resumed (Lifecycle Event)
May 14 03:43:39.406836 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4a35037-5fb0-473e-b82c-bc442a6235ec req-23beb443-0908-45fa-a04c-2b29a4ac864d service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:39.407680 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4a35037-5fb0-473e-b82c-bc442a6235ec req-23beb443-0908-45fa-a04c-2b29a4ac864d service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:39.407857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4a35037-5fb0-473e-b82c-bc442a6235ec req-23beb443-0908-45fa-a04c-2b29a4ac864d service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:39.407915 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4a35037-5fb0-473e-b82c-bc442a6235ec req-23beb443-0908-45fa-a04c-2b29a4ac864d service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:39.412005 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4a35037-5fb0-473e-b82c-bc442a6235ec req-23beb443-0908-45fa-a04c-2b29a4ac864d service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Processing event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:39.412005 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:39.412005 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:39.420303 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance spawned successfully.
May 14 03:43:39.422519 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:39.536374 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:39.538032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:39.825884 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:39.918875 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:39.919004 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing instance network info cache due to event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:39.920346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] Acquiring lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:39.920566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] Acquired lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:39.920756 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing network info cache for port 4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:39.932898 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-880ad479-23fd-4f53-bf4a-2cf135f7f94d tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.168s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:40.041359 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999684216999867 future=<Future at 0x79d0907886e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:40.042258 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998705813000015 future=<Future at 0x79d0907886e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:40.042389 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998536561000037 future=<Future at 0x79d0907886e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:40.042919 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730220.0426, f4a0bc29-17ad-4cd4-9fde-171f73f30a33 => ua-ed84f0a7-fcc2-4333-81c3-e484c9a26790> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:43:40.043129 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730220.0429304, 41fa8526-521c-46aa-af0a-434ff652136e => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:40.043239 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Resumed (Lifecycle Event)
May 14 03:43:40.052705 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully detached device vdb from instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 from the live domain config.
May 14 03:43:40.058775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:43:40.059215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:40.059391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:40.060667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:40.061579 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed84f0a7-fcc2-4333-81c3-e484c9a26790', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:43:40.061862 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:40.100071 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790 (non-flash)
May 14 03:43:40.100516 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', '121')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:43:40.100516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', '121')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:40.101699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790', '120')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:43:40.102607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81c2700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:43:40.102607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:43:40.102607 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Flush multipath device 3300000003b56b671 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:43:40.137794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:40.195773 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:43:40.202934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:40.204945 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:40.244297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:43:40.244492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:43:40.245967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:43:40.261019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:43:40.261354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:43:40.275353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.313469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.40.100,3260]
May 14 03:43:40.313469 np0000000741 nova-compute[97948]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.40.100,3260] successful.
May 14 03:43:40.313469 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.328303 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Took 1.90 seconds to deallocate network for instance.
May 14 03:43:40.334506 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.354152 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.384405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.50.100,3260]
May 14 03:43:40.384405 np0000000741 nova-compute[97948]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-ed84f0a7-fcc2-4333-81c3-e484c9a26790, portal: 192.168.50.100,3260] successful.
May 14 03:43:40.384405 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.402955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:40.403126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:40.403330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] <== disconnect_volume: return (343ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:40.403490 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:43:40.424455 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:40.546686 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:40.553441 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:40.708903 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:43:40.838756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:40.838756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:40.844743 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:40.992706 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'flavor' on Instance uuid f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:41.027743 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updated VIF entry in instance network info cache for port 4e51b4dc-190b-42e0-95b5-f061b10f594f. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:43:41.028343 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:41.278968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:41.292232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:41.292502 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:41.495747 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Received event network-vif-deleted-e5556cca-f97d-4076-99f5-69c144e18564 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:41.496376 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:41.496763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:41.496970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:41.497125 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:41.497448 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:41.499461 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b1a88670-c580-4d3a-912b-12fec8aaab65 req-7679f844-94b5-4374-b384-f7fc6117f209 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received unexpected event network-vif-plugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with vm_state active and task_state None.
May 14 03:43:41.518439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:41.518683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:41.531335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-88970a65-4ede-4f22-ab30-a958b5b6cba4 req-4dc84812-a79c-4c6b-b889-ae2c1b7927fb service nova] Releasing lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:41.795898 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:42.002233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e3468db7-fe58-4b23-899c-be7a0e814d41 tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.537s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:42.020875 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:43:42.302314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.465s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:42.303538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.025s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:42.306923 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:42.307062 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Claim successful on node np0000000741
May 14 03:43:42.326308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:42.326561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:42.326792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:42.326970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:42.327110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:42.329997 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Terminating instance
May 14 03:43:42.355468 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Deleted allocations for instance ce825ac9-1ee3-49dc-8a58-38a9447e8784
May 14 03:43:42.582412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:42.834611 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:43:42.862760 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.868256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.893072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.901672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.909672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.929539 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:42.930455 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.034565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:43.037913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:43.038462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:43.038632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:43.041870 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] No waiting events found dispatching network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:43.041870 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d63aedd-b4cd-45e0-aefb-b9dad6c9f9e5 req-f65d7074-871e-4509-9f17-4bd0233b4040 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:43.152793 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.179782 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999639124999703 future=<Future at 0x79d0b00f38f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:43.182776 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Instance destroyed successfully.
May 14 03:43:43.183664 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lazy-loading 'resources' on Instance uuid f4a0bc29-17ad-4cd4-9fde-171f73f30a33 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:43.364691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-15fdefd3-7f84-44ca-8455-6275c19cdd51 tempest-AttachVolumeShelveTestJSON-1886486107 tempest-AttachVolumeShelveTestJSON-1886486107-project-member] Lock "ce825ac9-1ee3-49dc-8a58-38a9447e8784" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.831s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:43.675907 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:43.676284 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:43.687279 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764562588',display_name='tempest-AttachVolumeNegativeTest-server-1764562588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumenegativetest-server-1764562588',id=45,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFDXyPR7X2rKfxv8JEGQZYk+OTyPE/DZCgioS8w7J3r6PUIlX6r8pG3zw0RNvBqxZ+DLt1SHudBQH6Xp2RYAkniqafDX53Mj7nPuFrDmIubLllwhQv3r9SE/fWE++I7fg==',key_name='tempest-keypair-576806903',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:42:45Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61f7491c96154009b61199ad430386d3',ramdisk_id='',reservation_id='r-wtg262g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1381632340',owner_user_name='tempest-AttachVolumeNegativeTest-1381632340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba9e32f212f04cae8a70c44b26647a59',uuid=f4a0bc29-17ad-4cd4-9fde-171f73f30a33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:43:43.687515 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converting VIF {"id": "2ccc3361-c6b3-428d-b977-84574e930774", "address": "fa:16:3e:4e:26:ed", "network": {"id": "44648dba-61b1-4bf9-95a4-13f7006e37e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2125747470-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "61f7491c96154009b61199ad430386d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ccc3361-c6", "ovs_interfaceid": "2ccc3361-c6b3-428d-b977-84574e930774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:43.688096 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:43.688346 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:43:43.690615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.690615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ccc3361-c6, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:43.691460 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.693239 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:43.694552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.695056 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8647b14-b109-45d9-986a-c088edbf4b8d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:43.695949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:43.696603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:43.699034 np0000000741 nova-compute[97948]: INFO os_vif [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ccc3361-c6b3-428d-b977-84574e930774,network=Network(44648dba-61b1-4bf9-95a4-13f7006e37e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ccc3361-c6')
May 14 03:43:43.699423 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Deleting instance files /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33_del
May 14 03:43:43.700252 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Deletion of /opt/stack/data/nova/instances/f4a0bc29-17ad-4cd4-9fde-171f73f30a33_del complete
May 14 03:43:43.728483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:44.178842 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:44.209630 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:43:44.210334 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:43:44.210334 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:43:44.210834 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:43:44.210989 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:44.425382 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:44.685938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.382s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:44.686631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.104s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:44.686957 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:43:44.692539 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:44.692671 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Claim successful on node np0000000741
May 14 03:43:44.989695 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fefc09a-f5e4-42bf-9c76-2566c27d2e64 req-875b8b18-8c6c-4622-9251-f8c39b04239e service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-deleted-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:44.991043 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-6fefc09a-f5e4-42bf-9c76-2566c27d2e64 req-875b8b18-8c6c-4622-9251-f8c39b04239e service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Neutron deleted interface 2ccc3361-c6b3-428d-b977-84574e930774; detaching it from the instance and deleting it from the info cache
May 14 03:43:44.991043 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6fefc09a-f5e4-42bf-9c76-2566c27d2e64 req-875b8b18-8c6c-4622-9251-f8c39b04239e service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:45.120242 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:45.120742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] Acquiring lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:45.120940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:45.121105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:45.121262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] No waiting events found dispatching network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:45.121510 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-043468a3-f22b-4d19-98cf-858b37a30701 req-e0c78c14-8740-46b6-849e-6cd72f9e6b28 service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Received event network-vif-unplugged-2ccc3361-c6b3-428d-b977-84574e930774 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:43:45.193310 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:43:45.193777 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:43:45.194253 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:45.194508 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:45.284803 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:43:45.433740 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:45.493753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fefc09a-f5e4-42bf-9c76-2566c27d2e64 req-875b8b18-8c6c-4622-9251-f8c39b04239e service nova] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Detach interface failed, port_id=2ccc3361-c6b3-428d-b977-84574e930774, reason: Instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:43:45.701268 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:43:45.888205 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Successfully created port: 8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:43:45.939957 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Took 1.73 seconds to deallocate network for instance.
May 14 03:43:46.135369 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:46.135604 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:46.203481 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:43:46.448668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:46.532781 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Successfully updated port: 8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:43:46.638274 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:46.712766 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Booting with volume c8d65405-8ecf-43d2-81b2-b975e59d500d at /dev/vda
May 14 03:43:46.762788 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:46.777087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:43:46.804749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:46.853663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:43:46.853887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:43:46.865571 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:43:46.866882 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe92:e4d2'] 
May 14 03:43:46.867052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:43:46.867224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:43:46.867438 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:46.867899 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating existing volume attachment record: 4cafed8d-8a54-473f-8492-ea6a50423ba5 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:43:47.038306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:47.038437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:47.038652 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:47.095626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-changed-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:47.095810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Refreshing instance network info cache due to event network-changed-8636c127-acb2-416b-a186-dd15447942af. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:47.095973 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] Acquiring lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:47.146210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.460s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:47.146828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.698s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:47.147043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:43:47.540005 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:47.540184 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:47.622885 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:47.655329 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:43:47.655329 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:43:47.655724 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:47.657785 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:47.770772 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:43:47.864593 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:48.048657 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:48.056860 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:48.159698 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:43:48.539451 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Successfully created port: 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:43:48.561821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:48.562118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance network_info: |[{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:43:48.563747 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] Acquired lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:48.563747 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Refreshing network info cache for port 8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:48.566367 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.420s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:48.647434 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Deleted allocations for instance f4a0bc29-17ad-4cd4-9fde-171f73f30a33
May 14 03:43:48.659983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:48.664821 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:43:48.696574 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:48.731739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:49.005843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:43:49.005843 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:43:49.005843 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Creating image(s)
May 14 03:43:49.005843 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:43:49.007180 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Ensure instance console log exists: /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:43:49.007765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:49.008173 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:49.008540 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:49.009286 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start _get_guest_xml network_info=[{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dc39231a-19ff-4111-91b3-0fb2c840da09', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'serial': 'c8d65405-8ecf-43d2-81b2-b975e59d500d'}, 'boot_index': 0, 'attachment_id': '4cafed8d-8a54-473f-8492-ea6a50423ba5', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:43:49.014386 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:49.017432 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1670587843', uuid='dc39231a-19ff-4111-91b3-0fb2c840da09'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730229.0163963) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:43:49.022850 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:43:49.023483 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:43:49.025776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:43:49.026185 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:43:49.027811 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:43:49.028368 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:43:49.028803 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:43:49.029709 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:43:49.029709 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:43:49.029709 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:43:49.029709 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:43:49.030147 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:43:49.033953 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:43:49.033953 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:43:49.033953 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:43:49.033953 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:43:49.054200 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:43:49.054690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:43:49.054824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:49.055453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:49.055783 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:43:49.073837 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:49.078836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:49.079516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:49.079796 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:49.081561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:43:49.083071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:43:49.083290 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:49.103182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:49.103182 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:49.111942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:43:49.111942 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:49.118808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d] added
May 14 03:43:49.118808 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:49.118808 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:49.118808 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:49.118808 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:49.118808 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:49.118808 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:49.121765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:49.121765 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:49.121765 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:49.126226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d] added
May 14 03:43:49.126226 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:43:49.126226 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:49.126226 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:49.126226 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:43:49.126226 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:43:49.126226 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:49.126628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:43:49.126775 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:43:49.127078 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:43:49.304936 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Successfully updated port: 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:43:49.368103 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:49.368361 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing instance network info cache due to event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:43:49.368560 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] Acquiring lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:49.368679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] Acquired lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:49.368810 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing network info cache for port 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:43:49.546061 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:49.667667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95c5b74c-4988-4603-9c4e-b5e2771301ea tempest-AttachVolumeNegativeTest-1381632340 tempest-AttachVolumeNegativeTest-1381632340-project-member] Lock "f4a0bc29-17ad-4cd4-9fde-171f73f30a33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.341s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:49.684493 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:43:49.685846 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:43:49.686489 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Creating image(s)
May 14 03:43:49.687414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:49.687586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:49.688054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:49.688568 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:49.693453 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:49.694922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:49.741919 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updated VIF entry in instance network info cache for port 8636c127-acb2-416b-a186-dd15447942af. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:43:49.743677 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:49.808512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:43:49.812089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:49.812502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:49.812880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:49.813402 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:49.816792 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:43:49.817150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:49.877704 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:49.937037 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:49.937894 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:49.993768 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:50.009425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk 1073741824" returned: 0 in 0.071s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:50.009964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:50.010330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:50.120474 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:43:50.121382 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:50.121952 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:43:50.122225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:50.140466 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:50.146843 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:50.146843 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.167090 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:43:50.179197 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:43:50.179197 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.187834 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.188153 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:50.199260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.229998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:50.231293 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:43:50.231775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:43:50.232009 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Ensure instance console log exists: /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:43:50.233400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:50.233606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:50.233908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:50.236345 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.240604 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:50.246495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260]
May 14 03:43:50.246495 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260] successful.
May 14 03:43:50.246495 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.248468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d72cdf00-b441-4c77-9a12-2c868b95c259 req-e8272032-ec7c-444b-9147-5f4359e012f7 service nova] Releasing lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:50.271210 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.290468 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.290869 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:50.291383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:50.291383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:50.295027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('11', '-', '-', 0) found on session 124 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:50.295205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:50.316844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260]
May 14 03:43:50.316844 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260] successful.
May 14 03:43:50.316844 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.320661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 124 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:50.322015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:50.339848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.367142 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:43:50.368003 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.285s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:50.368003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:43:50.369157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('12', '-', '-', 0) found on session 125 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:43:50.369315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:43:50.413510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 125 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:43:50.413510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:43:50.741038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-49ba8c3e-146c-4d6a-ab3f-6e3af9276bc9 req-2a6acaff-6cab-4035-b120-e52d1bc6414b service nova] Releasing lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:50.742363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:43:50.742630 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:43:51.083171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:43:51.331321 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:43:51.523854 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:51.684269 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating instance_info_cache with network_info: [{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:43:52.100418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 3300000004f57b759 for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:43:52.100927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:43:52.101230 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000004f57b759', 'path': '/dev/dm-6', 'multipath_id': '3300000004f57b759'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:43:52.101440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f57b759', 'path': '/dev/dm-6', 'multipath_id': '3300000004f57b759'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:43:52.186542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:43:52.186935 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance network_info: |[{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:43:52.189099 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Start _get_guest_xml network_info=[{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:43:52.193494 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:43:52.194724 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='85c0d018-04a6-4eeb-94c7-73c7077c43f1'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730232.194353) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:43:52.198876 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:43:52.201124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:43:52.203486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:43:52.204129 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:43:52.205186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:43:52.205673 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:43:52.206544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:43:52.206544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:43:52.206544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:43:52.206544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:43:52.206544 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:43:52.209610 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:43:52.209876 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:43:52.210054 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:43:52.210183 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:43:52.210714 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:43:52.232844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=51,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-cg7h00ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=85c0d018-04a6-4eeb-94c7-73c7077c43f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:43:52.232844 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:52.233380 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:52.234155 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:52.614461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:43:52.614702 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:52.615271 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:52.615793 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:43:52.738215 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] End _get_guest_xml xml=<domain type="qemu">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <uuid>85c0d018-04a6-4eeb-94c7-73c7077c43f1</uuid>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <name>instance-00000033</name>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-1</nova:name>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:43:52</nova:creationTime>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         <nova:port uuid="697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <system>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="serial">85c0d018-04a6-4eeb-94c7-73c7077c43f1</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="uuid">85c0d018-04a6-4eeb-94c7-73c7077c43f1</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </system>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <os>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </os>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <features>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </features>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   <devices>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.config"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b7:34:25"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <target dev="tap697d1fb0-c4"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </interface>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/console.log" append="off"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </serial>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <video>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </video>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </rng>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:   </devices>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]: </domain>
May 14 03:43:52.738215 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Preparing to wait for external event network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=51,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-cg7h00ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=85c0d018-04a6-4eeb-94c7-73c7077c43f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02e5b8a8-5539-5302-af45-9eceec70acb4', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.745514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:52.747709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.748698 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.748884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap697d1fb0-c4, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:52.749249 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap697d1fb0-c4, col_values=(('qos', UUID('4a48e8c0-8bdf-47bb-acd6-0c6cd81389dc')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:52.749453 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap697d1fb0-c4, col_values=(('external_ids', {'iface-id': '697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:34:25', 'vm-uuid': '85c0d018-04a6-4eeb-94c7-73c7077c43f1'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:52.750256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.752401 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:52.758934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:52.760447 np0000000741 nova-compute[97948]: INFO os_vif [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4')
May 14 03:43:53.118739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] End _get_guest_xml xml=<domain type="qemu">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <uuid>dc39231a-19ff-4111-91b3-0fb2c840da09</uuid>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <name>instance-00000032</name>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-1670587843</nova:name>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:43:49</nova:creationTime>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         <nova:port uuid="8636c127-acb2-416b-a186-dd15447942af">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <system>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="serial">dc39231a-19ff-4111-91b3-0fb2c840da09</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="uuid">dc39231a-19ff-4111-91b3-0fb2c840da09</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </system>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <os>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </os>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <features>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </features>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   <devices>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <alias name="ua-c8d65405-8ecf-43d2-81b2-b975e59d500d"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-6"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <serial>c8d65405-8ecf-43d2-81b2-b975e59d500d</serial>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </disk>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3a:ab:ca"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <target dev="tap8636c127-ac"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </interface>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/console.log" append="off"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </serial>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <video>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </video>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </rng>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:   </devices>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]: </domain>
May 14 03:43:53.118739 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Preparing to wait for external event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:43:53.122871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.123492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3ea95f-45bd-5302-826b-585ad6251d39', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:53.123890 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.124596 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:53.131032 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.133066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.133269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8636c127-ac, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:53.133561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8636c127-ac, col_values=(('qos', UUID('bc1fd02f-6916-421e-8d5b-b45061a261a6')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:53.133734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8636c127-ac, col_values=(('external_ids', {'iface-id': '8636c127-acb2-416b-a186-dd15447942af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ab:ca', 'vm-uuid': 'dc39231a-19ff-4111-91b3-0fb2c840da09'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:43:53.134503 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.136655 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:43:53.145747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:53.146810 np0000000741 nova-compute[97948]: INFO os_vif [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac')
May 14 03:43:53.734115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:54.278947 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:54.279383 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:54.279383 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:b7:34:25, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:54.279775 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Using config drive
May 14 03:43:54.670428 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:54.670667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:43:54.670763 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:3a:ab:ca, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:43:54.671364 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Using config drive
May 14 03:43:54.792112 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:54.925908 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Creating config drive at /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.config
May 14 03:43:54.934029 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3a3cvg6u {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:54.996033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3a3cvg6u" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:55.041565 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0006053769998288772 future=<Future at 0x79d0907886e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:55.042107 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730220.0408173, ce825ac9-1ee3-49dc-8a58-38a9447e8784 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:55.042264 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:55.042412 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] VM Stopped (Lifecycle Event)
May 14 03:43:55.044112 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.135285181999734 future=<Future at 0x79d0b00f38f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:55.044294 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.1350849729997208 future=<Future at 0x79d0b00f38f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:55.093109 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:55.093348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:55.182992 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:55.323825 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Creating config drive at /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config
May 14 03:43:55.329122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0cq5jpch {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:43:55.388800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0cq5jpch" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:43:55.495174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:55.530493 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:55.547525 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-2b653ab6-c6f2-4e62-8354-2ba887d273a9 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: ce825ac9-1ee3-49dc-8a58-38a9447e8784] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:55.595530 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:43:55.656186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:55.662073 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:55.695042 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:55.835800 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da70037-d60d-481b-8c37-4538bf3b00d1 req-9e6fbf77-e569-49b2-bc06-99b262c24315 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:55.836255 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da70037-d60d-481b-8c37-4538bf3b00d1 req-9e6fbf77-e569-49b2-bc06-99b262c24315 service nova] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:55.836405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da70037-d60d-481b-8c37-4538bf3b00d1 req-9e6fbf77-e569-49b2-bc06-99b262c24315 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:55.836543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6da70037-d60d-481b-8c37-4538bf3b00d1 req-9e6fbf77-e569-49b2-bc06-99b262c24315 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:55.837069 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6da70037-d60d-481b-8c37-4538bf3b00d1 req-9e6fbf77-e569-49b2-bc06-99b262c24315 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Processing event network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:56.093344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.125738 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.197515 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:56.197997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:56.208038 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:43:56.208316 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Claim successful on node np0000000741
May 14 03:43:56.236918 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.339790 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1475fe42-d719-413d-8184-31ef15b26ffd req-ae551cc2-c593-4564-9816-e4584c8dc543 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:56.340534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1475fe42-d719-413d-8184-31ef15b26ffd req-ae551cc2-c593-4564-9816-e4584c8dc543 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:56.340534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1475fe42-d719-413d-8184-31ef15b26ffd req-ae551cc2-c593-4564-9816-e4584c8dc543 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:56.340534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1475fe42-d719-413d-8184-31ef15b26ffd req-ae551cc2-c593-4564-9816-e4584c8dc543 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:56.340720 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1475fe42-d719-413d-8184-31ef15b26ffd req-ae551cc2-c593-4564-9816-e4584c8dc543 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Processing event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:43:56.495083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.501298 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.531230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.837007 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:56.993663 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730236.9918866, 85c0d018-04a6-4eeb-94c7-73c7077c43f1 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:56.993663 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] VM Started (Lifecycle Event)
May 14 03:43:56.994057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:56.997443 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:57.001497 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance spawned successfully.
May 14 03:43:57.001703 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:43:57.112769 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:43:57.114843 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:43:57.118342 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance spawned successfully.
May 14 03:43:57.120339 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:43:57.495692 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:57.497331 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:57.510282 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.510415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.510793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.511038 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.511330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.511661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.632339 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.634655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.634655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.634655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.634655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.634655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:43:57.664115 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:43:57.664193 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:43:57.931903 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:57.932328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:57.934092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:57.934904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:57.935854 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] No waiting events found dispatching network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:57.935854 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-dfef7938-58fd-4cba-a084-255dddb2d3cf req-a299fc22-f2aa-420c-973f-3f0754012933 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received unexpected event network-vif-plugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 for instance with vm_state building and task_state spawning.
May 14 03:43:58.000386 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:43:58.000386 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730237.9998443, 85c0d018-04a6-4eeb-94c7-73c7077c43f1 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:58.000386 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] VM Paused (Lifecycle Event)
May 14 03:43:58.020166 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Took 8.34 seconds to spawn the instance on the hypervisor.
May 14 03:43:58.020435 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:58.134791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:58.142014 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Took 9.14 seconds to spawn the instance on the hypervisor.
May 14 03:43:58.142014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:58.170541 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:43:58.180066 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0006513050002467935 future=<Future at 0x79d0b00f38f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:58.180204 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:43:58.180685 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730223.1793094, f4a0bc29-17ad-4cd4-9fde-171f73f30a33 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:58.181078 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] VM Stopped (Lifecycle Event)
May 14 03:43:58.423522 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:43:58.423600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:43:58.424633 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:43:58.424633 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:58.424633 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:43:58.424633 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1558a680-02c8-4ad8-85c7-83d5bdda49aa req-97906593-1400-4b6b-be29-a176f4f27c54 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state active and task_state None.
May 14 03:43:58.503578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:58.507933 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730238.5075793, 85c0d018-04a6-4eeb-94c7-73c7077c43f1 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:58.508102 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] VM Resumed (Lifecycle Event)
May 14 03:43:58.540457 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Took 16.01 seconds to build instance.
May 14 03:43:58.659784 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Took 17.45 seconds to build instance.
May 14 03:43:58.682527 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.485s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:58.685011 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:43:58.693840 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: f4a0bc29-17ad-4cd4-9fde-171f73f30a33] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:58.737272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:43:59.013463 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:43:59.017416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:43:59.044463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.526s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:59.162147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.959s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:43:59.192662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:43:59.194789 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:43:59.195805 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:59.196151 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:43:59.477581 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31460db6e0e54652a720e19805f2039a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ed7a6b1bbd4c5c9d85a5d211329ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:43:59.517939 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730239.5176196, dc39231a-19ff-4111-91b3-0fb2c840da09 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:43:59.518508 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Started (Lifecycle Event)
May 14 03:43:59.699881 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:44:00.021529 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:00.026699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:00.086119 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Successfully created port: 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:44:00.206018 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:44:00.469920 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-changed-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:00.470171 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Refreshing instance network info cache due to event network-changed-8636c127-acb2-416b-a186-dd15447942af. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:00.470328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] Acquiring lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:00.470364 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] Acquired lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:00.471219 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Refreshing network info cache for port 8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:00.513545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:00.513545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing instance network info cache due to event network-changed-4e51b4dc-190b-42e0-95b5-f061b10f594f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:00.513545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Acquiring lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:00.513545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Acquired lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:00.513545 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Refreshing network info cache for port 4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:00.531920 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730240.5316086, dc39231a-19ff-4111-91b3-0fb2c840da09 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:00.532372 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Paused (Lifecycle Event)
May 14 03:44:00.691190 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Successfully updated port: 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:44:00.712580 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Booting with volume 2a236d59-2b32-4c53-ac02-c98ac419fb6d at /dev/vda
May 14 03:44:00.755669 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-changed-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:00.755819 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing instance network info cache due to event network-changed-193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:00.756228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:00.756228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:00.756294 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing network info cache for port 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:00.776001 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:00.788658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:44:00.811932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:00.869473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:44:00.869800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:44:00.879969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:44:00.881188 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe3a:abca', 'fe80::14cb:8fff:fe43:ccbf'] 
May 14 03:44:00.881386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:44:00.881510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:44:00.881774 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:00.881993 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating existing volume attachment record: 61214277-dee6-4124-bc7c-b718dd108f42 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:44:00.974729 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:01.018668 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:01.034753 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:01.039066 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730241.038752, dc39231a-19ff-4111-91b3-0fb2c840da09 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:01.039386 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Resumed (Lifecycle Event)
May 14 03:44:01.193632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:01.258897 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:01.366280 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:01.393709 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:01.415448 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:01.544279 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:01.546356 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:01.621977 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updated VIF entry in instance network info cache for port 4e51b4dc-190b-42e0-95b5-f061b10f594f. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:01.622294 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [{"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:01.625026 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updated VIF entry in instance network info cache for port 8636c127-acb2-416b-a186-dd15447942af. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:01.625219 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:01.638691 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:02.127331 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-89a8482e-cf32-44c0-a9bb-732207f1f6b8 req-48469982-fd05-4137-b610-c252c95cf017 service nova] Releasing lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:02.128141 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Releasing lock "refresh_cache-179fc6e1-dfbb-4b6c-9dc7-9b1113470271" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:02.128395 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:02.128545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing instance network info cache due to event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:02.128781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Acquiring lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:02.128896 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Acquired lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:02.129054 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing network info cache for port 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:02.140015 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2e6ea0a-2921-450a-a933-11d247e12eb3 req-7852029e-f6f5-4737-aa10-5a819d308b26 service nova] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:02.140418 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:02.140592 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:44:02.218375 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:02.218542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:02.633728 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:02.724329 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:02.727504 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:02.919125 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:03.004597 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:44:03.005984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:44:03.005984 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Creating image(s)
May 14 03:44:03.006088 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:44:03.007898 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Ensure instance console log exists: /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:44:03.008126 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:03.008314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:03.008492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:03.009051 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:03.102033 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:03.135830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:03.169066 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updated VIF entry in instance network info cache for port 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:03.169356 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating instance_info_cache with network_info: [{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:03.604266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:03.604512 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance network_info: |[{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:44:03.605464 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Start _get_guest_xml network_info=[{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9', 'attached_at': '', 'detached_at': '', 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'serial': '2a236d59-2b32-4c53-ac02-c98ac419fb6d'}, 'boot_index': 0, 'attachment_id': '61214277-dee6-4124-bc7c-b718dd108f42', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:44:03.608062 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:44:03.609517 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1268328156', uuid='1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9'), owner=OwnerMeta(userid='31460db6e0e54652a720e19805f2039a', username='tempest-TestInstancesWithCinderVolumes-2040779555-project-member', projectid='13ed7a6b1bbd4c5c9d85a5d211329ed1', projectname='tempest-TestInstancesWithCinderVolumes-2040779555'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730243.6091013) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:44:03.610823 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:44:03.611516 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:44:03.612413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:44:03.612685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:44:03.613897 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:44:03.614324 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:44:03.614605 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:44:03.614832 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:44:03.615056 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:44:03.615214 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:44:03.615396 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:44:03.615622 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:44:03.615829 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:44:03.616015 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:44:03.616161 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:44:03.616364 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:44:03.629806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:44:03.630284 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:03.630422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:03.671823 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f4a1ab6-136d-4a0a-a779-f0613bac0072 req-92831857-1247-4954-9100-a62a62980384 service nova] Releasing lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:03.734428 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:03.749751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:04.855938 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:04.856453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:04.856453 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Attaching volume 59f53085-3780-4139-b44a-8547c0206c36 to /dev/vdb
May 14 03:44:04.905040 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:04.921713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:44:04.948464 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:05.006590 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:44:05.009707 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:44:05.019789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:44:05.021288 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe3a:abca', 'fe80::14cb:8fff:fe43:ccbf'] 
May 14 03:44:05.021465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:44:05.021465 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:44:05.021991 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:05.022131 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating existing volume attachment record: 234f1ab3-dcc4-4190-b799-b0c918ff6570 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:44:05.287766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.657s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:05.288137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:44:05.300814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:05.301337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:05.301522 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:05.302225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:05.302838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:05.303107 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:05.314666 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:05.314666 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:05.321014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:05.321014 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:05.329953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d] added
May 14 03:44:05.329953 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:05.329953 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:05.329953 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:05.329953 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:05.329953 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:05.329953 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:05.330119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:05.331725 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:05.331725 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d] added
May 14 03:44:05.335266 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:05.335266 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:05.335266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:05.335840 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:05.335840 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:05.607734 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:44:05.610102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:05.610102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:06.331037 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:06.336018 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:06.346262 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:06.346262 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:06.356157 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:06.356157 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.365213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.373461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.383802 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.396132 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.396382 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:06.434990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.40.100,3260]
May 14 03:44:06.434990 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.40.100,3260] successful.
May 14 03:44:06.434990 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.450518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.452448 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.50.100,3260]
May 14 03:44:06.452448 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.50.100,3260] successful.
May 14 03:44:06.452448 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.469765 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:06.470684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.471816 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:06.471816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:06.473610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('15', '-', '-', 0) found on session 128 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:06.473875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.493050 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:06.493608 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:06.493608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:06.494595 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('16', '-', '-', 0) found on session 129 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:06.494701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:06.519209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 128 and hctl ['15', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:06.530096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 129 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:06.530096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:07.516267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 128 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:07.516778 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:08.137714 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:08.320357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found WWN 330000000276e40d0 for multipath device dm-3 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:44:08.320799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:08.324159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.711s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:08.324610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== connect_volume: return (4693ms) {'type': 'block', 'scsi_wwn': '330000000276e40d0', 'path': '/dev/dm-3', 'multipath_id': '330000000276e40d0'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:08.324897 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:44:08.325205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000276e40d0', 'path': '/dev/dm-3', 'multipath_id': '330000000276e40d0'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:44:08.338452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:08.339154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:08.339362 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:08.339595 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:08.340073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:08.340207 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:08.351679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:08.351679 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:08.358007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:08.358007 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:08.365378 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36] added
May 14 03:44:08.365378 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:08.365378 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:08.365378 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:08.365378 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:08.365378 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:08.365378 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:08.365726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:08.366012 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:08.366216 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:08.369019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36] added
May 14 03:44:08.369019 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:08.369019 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:08.369019 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:08.369019 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:08.369019 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:08.369019 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:08.369242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:08.369312 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:08.369476 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:08.752186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:08.832714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1268328156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testinstanceswithcindervolumes-server-1268328156',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWmMXlc0Sgi5/C6KQRIK02ZyZibaHqFjRdrBog36rpqe+1oSqigVaId7lKyN9BG1ZH2KBKrc+n3Tv09KSnUACplRwPkMQkKIu/zqi0z7JWjbQ7pTfAtR5FLGy4SevRniQ==',key_name='tempest-TestInstancesWithCinderVolumes-25559803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ed7a6b1bbd4c5c9d85a5d211329ed1',ramdisk_id='',reservation_id='r-2x0lr4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-2040779555',owner_user_name='tempest-TestInstancesWithCinderVolumes-2040779555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:00Z,user_data=None,user_id='31460db6e0e54652a720e19805f2039a',uuid=1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:44:08.832956 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converting VIF {"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:08.833878 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:08.837438 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:09.341748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] End _get_guest_xml xml=<domain type="qemu">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <uuid>1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9</uuid>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <name>instance-00000034</name>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1268328156</nova:name>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:44:03</nova:creationTime>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:user uuid="31460db6e0e54652a720e19805f2039a">tempest-TestInstancesWithCinderVolumes-2040779555-project-member</nova:user>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:project uuid="13ed7a6b1bbd4c5c9d85a5d211329ed1">tempest-TestInstancesWithCinderVolumes-2040779555</nova:project>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         <nova:port uuid="193c146f-3184-4c67-b207-5bcf01065988">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <system>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="serial">1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="uuid">1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </system>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <os>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </os>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <features>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </features>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   <devices>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/disk.config"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <alias name="ua-2a236d59-2b32-4c53-ac02-c98ac419fb6d"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-3"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <serial>2a236d59-2b32-4c53-ac02-c98ac419fb6d</serial>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:db:05:39"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <target dev="tap193c146f-31"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </interface>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/console.log" append="off"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </serial>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <video>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </video>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </rng>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:   </devices>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]: </domain>
May 14 03:44:09.341748 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Preparing to wait for external event network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1268328156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testinstanceswithcindervolumes-server-1268328156',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWmMXlc0Sgi5/C6KQRIK02ZyZibaHqFjRdrBog36rpqe+1oSqigVaId7lKyN9BG1ZH2KBKrc+n3Tv09KSnUACplRwPkMQkKIu/zqi0z7JWjbQ7pTfAtR5FLGy4SevRniQ==',key_name='tempest-TestInstancesWithCinderVolumes-25559803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ed7a6b1bbd4c5c9d85a5d211329ed1',ramdisk_id='',reservation_id='r-2x0lr4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-2040779555',owner_user_name='tempest-TestInstancesWithCinderVolumes-2040779555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:00Z,user_data=None,user_id='31460db6e0e54652a720e19805f2039a',uuid=1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converting VIF {"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.345090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:09.346238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:44:09.346501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.346711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b48ace4-9e58-5817-8fce-67a55073e2b3', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:09.348751 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.350694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:09.351844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.351996 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap193c146f-31, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:09.352348 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap193c146f-31, col_values=(('qos', UUID('b98506e6-3cc0-45cf-a10f-97d6451aafe2')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:09.352557 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap193c146f-31, col_values=(('external_ids', {'iface-id': '193c146f-3184-4c67-b207-5bcf01065988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:05:39', 'vm-uuid': '1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:09.355661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.356839 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:09.361618 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:09.363121 np0000000741 nova-compute[97948]: INFO os_vif [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31')
May 14 03:44:09.366605 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:09.370524 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:09.391427 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:09.391427 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:09.405014 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:09.405014 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.412732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.424477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.437057 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.438154 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.453006 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.453487 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:09.491091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.40.100,3260]
May 14 03:44:09.491091 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.40.100,3260] successful.
May 14 03:44:09.491091 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.509059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.524973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.50.100,3260]
May 14 03:44:09.524973 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.50.100,3260] successful.
May 14 03:44:09.524973 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.532012 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:09.532631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:09.532631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:09.534377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('17', '-', '-', 0) found on session 130 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:09.534377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:09.544150 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:09.558915 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 130 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:09.558915 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.568314 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03cf5305-62a2-4224-b2b7-e2f97a5711ae (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:09.571789 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('18', '-', '-', 0) found on session 131 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:09.571789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:09.593157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 131 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:09.593157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:10.340080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:44:10.884674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:10.884674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:10.884674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No VIF found with MAC fa:16:3e:db:05:39, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:10.885244 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Using config drive
May 14 03:44:11.360770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 330000000b3b96831 for multipath device dm-12 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:44:11.360770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:11.360770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (5750ms) {'type': 'block', 'scsi_wwn': '330000000b3b96831', 'path': '/dev/dm-12', 'multipath_id': '330000000b3b96831'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:11.360770 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b3b96831', 'path': '/dev/dm-12', 'multipath_id': '330000000b3b96831'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:44:11.364482 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:11.395666 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:11.584993 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Creating config drive at /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/disk.config
May 14 03:44:11.588233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgu1n9kv3 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:11.642797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgu1n9kv3" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:11.870475 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Attempting to attach volume 59f53085-3780-4139-b44a-8547c0206c36 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:44:11.872933 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:11.872933 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:44:12.263158 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.298906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.409279 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.546662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc5a1e81-304d-4d38-9b3f-4c6a4bb7d8ea req-eb0f4640-faa0-4ba1-bfe2-66fa1c68961d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:12.547048 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc5a1e81-304d-4d38-9b3f-4c6a4bb7d8ea req-eb0f4640-faa0-4ba1-bfe2-66fa1c68961d service nova] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:12.547191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc5a1e81-304d-4d38-9b3f-4c6a4bb7d8ea req-eb0f4640-faa0-4ba1-bfe2-66fa1c68961d service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:12.547381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc5a1e81-304d-4d38-9b3f-4c6a4bb7d8ea req-eb0f4640-faa0-4ba1-bfe2-66fa1c68961d service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:12.547489 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc5a1e81-304d-4d38-9b3f-4c6a4bb7d8ea req-eb0f4640-faa0-4ba1-bfe2-66fa1c68961d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Processing event network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:44:12.687956 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.689941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.694170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:12.722593 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:13.318729 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:44:13.320163 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730253.31911, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:13.320477 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] VM Started (Lifecycle Event)
May 14 03:44:13.322454 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:44:13.325750 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance spawned successfully.
May 14 03:44:13.326336 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:44:13.700132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:13.700979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:13.700979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:13.700979 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:92:e4:d2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:13.755478 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:13.823981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:13.833687 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:13.835662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:13.835974 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:13.836226 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:13.836844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:13.837002 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:13.837776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:14.343519 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:44:14.344040 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730254.3434968, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:14.344040 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] VM Paused (Lifecycle Event)
May 14 03:44:14.351910 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Took 11.35 seconds to spawn the instance on the hypervisor.
May 14 03:44:14.352947 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:14.355256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:14.632972 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:14.633870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:14.634041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:14.634169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:14.634289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] No waiting events found dispatching network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:14.634399 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5d7be3d8-0bd9-41c6-9b1a-07b8b488e3b8 req-de96c998-a694-4717-8d8e-90b9bda05a73 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received unexpected event network-vif-plugged-193c146f-3184-4c67-b207-5bcf01065988 for instance with vm_state active and task_state None.
May 14 03:44:14.853865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:14.858590 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730254.858235, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:14.858871 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] VM Resumed (Lifecycle Event)
May 14 03:44:14.870208 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Took 18.76 seconds to build instance.
May 14 03:44:15.285814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38970fe7-08da-4921-9f08-09ad06d5f948 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.430s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:15.363219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:15.365775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:15.376451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7ee9af17-f648-4dfe-9d02-b01f70539c24 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.283s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:15.383685 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:15.383950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:15.892499 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:16.318378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-changed-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:16.319069 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing instance network info cache due to event network-changed-193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:16.319598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:16.320181 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:16.320181 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing network info cache for port 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:16.824170 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:16.907977 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:17.245597 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:17.445920 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updated VIF entry in instance network info cache for port 193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:17.446396 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:17.832225 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:17.833018 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing instance network info cache due to event network-changed-bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:17.833018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] Acquiring lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:17.833215 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] Acquired lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:17.833263 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Refreshing network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:17.952242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6216c686-9ab4-47e1-aada-5041d1602f4f req-02915abe-edc5-4637-ba36-240a00ec7ff0 service nova] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:18.029557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:18.029757 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:18.029950 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Attaching volume 59f53085-3780-4139-b44a-8547c0206c36 to /dev/vdb
May 14 03:44:18.085566 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:18.099777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:44:18.120512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:18.172397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:44:18.172599 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:44:18.182484 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:44:18.183749 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe14:695e', 'fe80::74ad:65ff:fe3b:932', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe3a:abca', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d'] 
May 14 03:44:18.183984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:44:18.184094 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:44:18.184417 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:18.184595 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating existing volume attachment record: 5033ba9d-a0e4-421c-a12b-4aac95322d84 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:44:18.306311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:18.306311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:18.306311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:18.306311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:18.306311 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:18.307177 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Terminating instance
May 14 03:44:18.338122 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:18.506269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-changed-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:18.507909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing instance network info cache due to event network-changed-193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:18.509990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:18.510110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:18.511504 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing network info cache for port 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:18.704495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:18.744769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:44:18.744769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:18.744769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:18.744769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:18.744769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:44:18.759054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:18.761629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:18.762331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:18.762821 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:18.762965 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:18.763422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:18.763607 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:18.776259 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:18.776259 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:18.785798 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:18.785798 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:18.793561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:18.801409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:18.810972 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.817494 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.817978 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:18.818377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:18.818377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:18.820134 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('17', '0', '0', 0) found on session 130 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:18.820134 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:18.827452 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:18.828047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:18.828047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:18.829081 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('18', '0', '0', 0) found on session 131 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:18.829081 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:18.836442 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:18.839842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 130 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:18.839842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:18.839842 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:18.846217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 131 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:18.846217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:18.857724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:18.875598 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updated VIF entry in instance network info cache for port bee297ca-9526-4351-9c29-e8c837c03eef. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:18.875846 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [{"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:18.876786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:18.898143 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.016944 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:19.027514 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:19.027514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:19.027514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:19.027712 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:19.027938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:19.028104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-498e9eab-92d1-45a6-af68-27d5e11bd146 req-67b96fa0-f743-4cdf-bd83-de29b3af1ea4 service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:44:19.134906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.167448 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999657278000086 future=<Future at 0x79d0b075a030 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:19.168720 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998721713000123 future=<Future at 0x79d0b075a030 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:19.168720 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998483893999946 future=<Future at 0x79d0b075a030 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:19.170945 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Instance destroyed successfully.
May 14 03:44:19.174190 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lazy-loading 'resources' on Instance uuid 41fa8526-521c-46aa-af0a-434ff652136e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:19.356274 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.377963 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9fac1ce-7be4-4001-88f1-cd14e9143a32 req-80a646e1-ca1f-4725-ab69-dcaa1b59f1ab service nova] Releasing lock "refresh_cache-41fa8526-521c-46aa-af0a-434ff652136e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:19.406745 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:19.565581 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updated VIF entry in instance network info cache for port 193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:19.565998 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:19.677346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-529657334',display_name='tempest-TestShelveInstance-server-529657334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testshelveinstance-server-529657334',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJAaEb7Aw5VXcLzpycVxwcd9o6oTebKWtAqPywhgNRIKAuhok5gdAzse7ORV5yUZmEfupQHP2692VEepEaLPgHQjPHZHgUD/KYqX3LZ90R24RRJ2UgPQFwLTmxG/HKGwg==',key_name='tempest-TestShelveInstance-1074333860',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:39Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='881e23fb403045d89cc278cce41eb2a5',ramdisk_id='',reservation_id='r-rpzctadu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1690582218',owner_user_name='tempest-TestShelveInstance-1690582218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:39Z,user_data=None,user_id='33d5d5f4d4d84196956203afe36f6d37',uuid=41fa8526-521c-46aa-af0a-434ff652136e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:44:19.677599 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converting VIF {"id": "bee297ca-9526-4351-9c29-e8c837c03eef", "address": "fa:16:3e:14:69:5e", "network": {"id": "a3181334-d613-4332-b737-c7654d0a9848", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267591755-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "881e23fb403045d89cc278cce41eb2a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee297ca-95", "ovs_interfaceid": "bee297ca-9526-4351-9c29-e8c837c03eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:19.678411 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:19.678736 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:44:19.680835 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.680892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbee297ca-95, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:19.682535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.683617 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:19.684218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.685114 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:19.685281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcfa13b5-2b91-4a2d-b3e1-2c0d84ca640b) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:19.687270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:19.689159 np0000000741 nova-compute[97948]: INFO os_vif [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:69:5e,bridge_name='br-int',has_traffic_filtering=True,id=bee297ca-9526-4351-9c29-e8c837c03eef,network=Network(a3181334-d613-4332-b737-c7654d0a9848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee297ca-95')
May 14 03:44:19.690800 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:44:19.691147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:19.691329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:19.764539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:44:20.068132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-36a3b06a-c16f-4779-942f-d2b94026ee56 req-286659bb-528a-4620-b173-591318cf1ac6 service nova] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:20.548761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:20.780124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 330000000b3b96831 for multipath device dm-12 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:44:20.780395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:20.780596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000b3b96831', 'path': '/dev/dm-12', 'multipath_id': '330000000b3b96831'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:20.780774 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b3b96831', 'path': '/dev/dm-12', 'multipath_id': '330000000b3b96831'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:44:20.781171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.090s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:20.781412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:44:20.781573 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:44:20.786319 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:20.815872 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:20.816824 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eb4b29f-e404-42b9-85ab-ec093b6de221', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '131')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:44:20.816824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '119')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:20.817750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3', '118')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:20.818389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0035f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'): ({'sdb'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:44:20.818598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:44:20.819165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Flush multipath device 33000000081858413 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:44:20.876964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:20.938228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:20.986469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:44:20.986611 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:44:20.988060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:44:21.001242 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:44:21.001747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:44:21.015749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.049974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260]
May 14 03:44:21.049974 np0000000741 nova-compute[97948]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.40.100,3260] successful.
May 14 03:44:21.049974 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.073313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.088058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.104164 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:21.104464 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] Acquiring lock "41fa8526-521c-46aa-af0a-434ff652136e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:21.104542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:21.104773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] Lock "41fa8526-521c-46aa-af0a-434ff652136e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:21.105227 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] No waiting events found dispatching network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:21.105347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67581674-a775-4170-a3c3-d4382a4d5e6f req-3487b786-4e73-48ff-9ffb-457fbfc72f9c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-unplugged-bee297ca-9526-4351-9c29-e8c837c03eef for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:44:21.123830 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260]
May 14 03:44:21.123830 np0000000741 nova-compute[97948]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-fcc626a8-7b3a-4876-81c5-83430f2b8fd3, portal: 192.168.50.100,3260] successful.
May 14 03:44:21.123830 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.144759 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:21.145002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:21.145155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] <== disconnect_volume: return (1453ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:21.145284 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:44:21.145554 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deleting instance files /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e_del
May 14 03:44:21.146081 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deletion of /opt/stack/data/nova/instances/41fa8526-521c-46aa-af0a-434ff652136e_del complete
May 14 03:44:21.290019 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Attempting to attach volume 59f53085-3780-4139-b44a-8547c0206c36 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:44:21.292509 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:21.292509 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:44:21.651790 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Took 2.84 seconds to destroy the instance on the hypervisor.
May 14 03:44:21.652390 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:44:21.652811 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:44:21.652935 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:44:21.653226 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:21.782045 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:22.108153 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1d7d0205-bcf8-43f8-a654-f9d81ee887ad req-ed19d465-03d2-439a-b7e7-46b248d03f7c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Received event network-vif-deleted-bee297ca-9526-4351-9c29-e8c837c03eef {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:22.112676 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-1d7d0205-bcf8-43f8-a654-f9d81ee887ad req-ed19d465-03d2-439a-b7e7-46b248d03f7c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Neutron deleted interface bee297ca-9526-4351-9c29-e8c837c03eef; detaching it from the instance and deleting it from the info cache
May 14 03:44:22.112676 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1d7d0205-bcf8-43f8-a654-f9d81ee887ad req-ed19d465-03d2-439a-b7e7-46b248d03f7c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:22.537704 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:22.613117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1d7d0205-bcf8-43f8-a654-f9d81ee887ad req-ed19d465-03d2-439a-b7e7-46b248d03f7c service nova] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Detach interface failed, port_id=bee297ca-9526-4351-9c29-e8c837c03eef, reason: Instance 41fa8526-521c-46aa-af0a-434ff652136e could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:44:22.951077 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:22.951221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:22.951378 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:22.951464 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:b7:34:25, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:23.039919 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Took 1.39 seconds to deallocate network for instance.
May 14 03:44:23.593353 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:44:23.599155 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Deleting volume: fcc626a8-7b3a-4876-81c5-83430f2b8fd3 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:44:23.762389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:24.136631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:24.136835 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:24.506162 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:24.515328 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2928576f-dc0b-41d0-9d07-54be05ff9c62 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.485s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:24.525026 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:44:24.525320 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:44:24.686278 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:25.029281 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:44:25.088312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:25.088806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:25.537694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.401s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:25.590813 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Detaching volume 59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:25.601201 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Deleted allocations for instance 41fa8526-521c-46aa-af0a-434ff652136e
May 14 03:44:25.648459 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Attempting to driver detach volume 59f53085-3780-4139-b44a-8547c0206c36 from mountpoint /dev/vdb
May 14 03:44:25.655472 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-59f53085-3780-4139-b44a-8547c0206c36 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:44:25.656486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-59f53085-3780-4139-b44a-8547c0206c36 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:44:25.656596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Attempting to detach device vdb from instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:44:25.656867 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:25.656867 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:44:25.671882 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 from the persistent domain config.
May 14 03:44:25.672059 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] (1/8): Attempting to detach device vdb with device alias ua-59f53085-3780-4139-b44a-8547c0206c36 from instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:44:25.672317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:25.672317 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:44:26.202503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730266.202181, 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 => ua-59f53085-3780-4139-b44a-8547c0206c36> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:44:26.203753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-59f53085-3780-4139-b44a-8547c0206c36 for instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:44:26.205876 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 from the live domain config.
May 14 03:44:26.325853 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.326334 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.326334 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.326712 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.327257 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.45 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:26.616827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba3b75f4-187e-4d1c-aee1-8eeaa32279c1 tempest-TestShelveInstance-1690582218 tempest-TestShelveInstance-1690582218-project-member] Lock "41fa8526-521c-46aa-af0a-434ff652136e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.313s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:26.750008 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Detected multiple connections on this host for volume: 59f53085-3780-4139-b44a-8547c0206c36, skipping target disconnect.
May 14 03:44:26.778673 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.779999 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:26.783453 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.784272 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:26.784272 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:44:26.784795 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:27.155471 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:27.318326 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:27.783546 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:28.290559 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:28.290761 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:28.290882 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:28.290992 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:44:28.328389 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f3360a4a-c3ee-4915-97a9-67185be4df95 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.240s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:28.361139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:28.524163 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:28.524410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:28.768260 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:29.028355 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Detaching volume 59f53085-3780-4139-b44a-8547c0206c36
May 14 03:44:29.070661 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Attempting to driver detach volume 59f53085-3780-4139-b44a-8547c0206c36 from mountpoint /dev/vdb
May 14 03:44:29.074152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-59f53085-3780-4139-b44a-8547c0206c36 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:44:29.075370 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-59f53085-3780-4139-b44a-8547c0206c36 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:44:29.075429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Attempting to detach device vdb from instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:44:29.075684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:29.075684 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:44:29.080175 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 from the persistent domain config.
May 14 03:44:29.080289 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] (1/8): Attempting to detach device vdb with device alias ua-59f53085-3780-4139-b44a-8547c0206c36 from instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:44:29.080478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <alias name="ua-59f53085-3780-4139-b44a-8547c0206c36"/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-12"/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <serial>59f53085-3780-4139-b44a-8547c0206c36</serial>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]: </disk>
May 14 03:44:29.080478 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:44:29.331761 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:44:29.335445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:44:29.337100 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:44:29.339100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:29.443046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:29.444849 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:29.550573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:29.556264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:29.649498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:29.649498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:29.690523 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:29.759667 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:29.759918 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-12 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:44:29.769980 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:44:29.771449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:29.827769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:29.828221 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12456MB free_disk=72.96990203857422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:44:29.828422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:29.829119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:30.457759 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:30.513445 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance dc39231a-19ff-4111-91b3-0fb2c840da09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:44:30.896384 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:44:29 up 36 min,  2 users,  load average: 6.33, 6.77, 4.60\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '3', 'io_workload': '0', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1', 'num_proj_13ed7a6b1bbd4c5c9d85a5d211329ed1': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:44:31.202302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:44:31.202499 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:44:31.705765 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:44:32.215628 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:44:32.216897 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.388s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:32.217037 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:32.482471 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730272.4818401, 85c0d018-04a6-4eeb-94c7-73c7077c43f1 => ua-59f53085-3780-4139-b44a-8547c0206c36> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:44:32.484816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-59f53085-3780-4139-b44a-8547c0206c36 for instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:44:32.490440 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 from the live domain config.
May 14 03:44:32.519049 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:32.544319 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:44:32.544912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:32.545114 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:32.545713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:32.546128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f53085-3780-4139-b44a-8547c0206c36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:44:32.546311 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a4e680f-912d-4135-a8c6-c3f8f63cf01a (non-flash)
May 14 03:44:32.576199 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36 (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a4e680f-912d-4135-a8c6-c3f8f63cf01a (non-flash)
May 14 03:44:32.576598 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:32.576598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a4e680f-912d-4135-a8c6-c3f8f63cf01a', '132')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:44:32.576952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '130')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:32.578524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36', '131')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:32.579690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0037ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'): ({'sdm'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:44:32.579951 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Removing multipathed devices sdm, sdl {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:44:32.580307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flush multipath device 330000000b3b96831 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:44:32.619745 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:32.674554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:32.722251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:44:32.722251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:44:32.724633 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:44:32.736261 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:44:32.736476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:44:32.749766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.797280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.40.100,3260]
May 14 03:44:32.797280 np0000000741 nova-compute[97948]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.40.100,3260] successful.
May 14 03:44:32.797280 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.819786 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.834571 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.871222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.50.100,3260]
May 14 03:44:32.871222 np0000000741 nova-compute[97948]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-59f53085-3780-4139-b44a-8547c0206c36, portal: 192.168.50.100,3260] successful.
May 14 03:44:32.871222 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.890654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:32.890871 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:32.890998 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== disconnect_volume: return (346ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:32.891130 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:44:33.217623 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:44:33.218017 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.56 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:33.453130 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:33.768076 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:34.167552 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004072800002177246 future=<Future at 0x79d0b075a030 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:34.168271 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730259.1669722, 41fa8526-521c-46aa-af0a-434ff652136e => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:34.168818 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:34.168818 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] VM Stopped (Lifecycle Event)
May 14 03:44:34.466914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0ab3d06b-0000-446a-ac4c-74752e9ce0ce tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.942s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:34.582442 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:34.582825 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:34.670990 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-83c0e9a3-ab6d-4f9c-bc37-639e385614be tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 41fa8526-521c-46aa-af0a-434ff652136e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:34.692227 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:35.085057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:44:35.639610 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:35.639807 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:35.643282 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:44:35.643454 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Claim successful on node np0000000741
May 14 03:44:35.744176 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:36.562485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:36.564059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:37.039835 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:44:37.040049 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:44:37.066265 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:44:37.451502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:37.451743 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:37.451853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:37.454273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97948) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 03:44:37.454593 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'flavor' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:37.542709 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:44:37.617448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:38.050300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.410s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:38.050820 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:44:38.053599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.437s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:38.056929 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:44:38.058585 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Claim successful on node np0000000741
May 14 03:44:38.069954 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.489359 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.491540 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.502557 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:44:38.507128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.511068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.530380 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.535858 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.556461 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:44:38.556663 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:44:38.557060 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:38.557320 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:38.624226 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b22f01567d3c4627b6832a1715577c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf39e19ddaa4d198e5c04679478fb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:44:38.697238 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:38.698089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:38.698276 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:38.698398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:38.698564 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:38.698746 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-efb6e1fb-5528-45c7-8c59-0ee3118bbcf7 req-0033fdb5-d8e3-4e7e-8d66-2fa08ec3de5a service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state active and task_state powering-off.
May 14 03:44:38.769029 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:38.782071 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999734580000222 future=<Future at 0x79d0907481d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:38.782646 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999199673000021 future=<Future at 0x79d0907481d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:38.782779 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999030402000244 future=<Future at 0x79d0907481d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:38.784160 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance destroyed successfully.
May 14 03:44:38.784652 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'numa_topology' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:38.998103 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Successfully created port: 22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:44:39.061332 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:44:39.286719 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:39.286922 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:39.420242 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:44:39.420480 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:44:39.514434 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Successfully updated port: 22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:44:39.566388 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:44:39.573353 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-changed-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:39.573515 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Refreshing instance network info cache due to event network-changed-22a31916-92e1-41f7-80e9-5be6328fbd64. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:39.573698 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] Acquiring lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:39.573784 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] Acquired lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:39.576931 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Refreshing network info cache for port 22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:39.693823 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:39.793366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-20a40480-3308-4080-9421-771ad862a78a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.342s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:39.923130 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:44:40.017280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:40.080296 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:40.151848 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:40.297325 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:40.432339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.379s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:40.432734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:44:40.575272 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:44:40.576372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:44:40.576633 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Creating image(s)
May 14 03:44:40.577406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:40.577512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:40.578184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:40.578816 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:40.582951 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:40.584303 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:40.677733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:40.678707 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:40.678960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:40.681056 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:40.687023 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:40.687514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:40.780426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:40.780879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:40.803724 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:40.804492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:40.805814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3347b3b0-cd11-4892-a79d-5746985e6f19 req-350e70df-0c91-4de5-8646-b3ed04900a98 service nova] Releasing lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:40.806196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:40.806767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquired lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:40.807142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:40.807298 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:44:40.808938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:40.809128 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b00340f4-d2b7-4132-8e52-309475ae2e3f req-f5be48f6-a612-475a-81fc-d13cf7736bcd service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state stopped and task_state None.
May 14 03:44:40.850312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk 1073741824" returned: 0 in 0.069s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:40.850735 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:40.850990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:40.942688 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:44:40.944481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:40.945478 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:44:40.945629 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:44:40.945874 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:40.956586 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:40.959958 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:41.050759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:41.051174 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Cannot resize image /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:44:41.051600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:44:41.051819 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Ensure instance console log exists: /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:44:41.052455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:41.052730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:41.052962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:41.068911 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:44:41.232829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:41.386256 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:41.444793 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:44:41.522416 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'flavor' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:41.564820 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:41.715564 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Updating instance_info_cache with network_info: [{"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:41.947813 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:44:42.026488 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:42.026586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:42.026946 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:44:42.026946 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'info_cache' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:42.084746 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Successfully created port: 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:44:42.217855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Releasing lock "refresh_cache-76e55967-48f2-4f6f-a421-83a219d83f2d" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:42.218085 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance network_info: |[{"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:44:42.219797 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Start _get_guest_xml network_info=[{"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:44:42.223255 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:44:42.224707 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-72008301', uuid='76e55967-48f2-4f6f-a421-83a219d83f2d'), owner=OwnerMeta(userid='b22f01567d3c4627b6832a1715577c13', username='tempest-VolumesActionsTest-1771154880-project-member', projectid='0cf39e19ddaa4d198e5c04679478fb89', projectname='tempest-VolumesActionsTest-1771154880'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730282.2240903) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:44:42.225542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:44:42.225880 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:44:42.226851 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:44:42.226964 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:44:42.228056 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:44:42.228122 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:44:42.228543 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:44:42.228543 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:44:42.228543 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:44:42.228543 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:44:42.228692 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:44:42.228788 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:44:42.228870 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:44:42.228913 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:44:42.228994 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:44:42.229088 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:44:42.239555 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-72008301',display_name='tempest-VolumesActionsTest-instance-72008301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-72008301',id=53,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf39e19ddaa4d198e5c04679478fb89',ramdisk_id='',reservation_id='r-hmb0fv7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1771154880',owner_user_name='tempest-VolumesActionsTest-1771154880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:40Z,user_data=None,user_id='b22f01567d3c4627b6832a1715577c13',uuid=76e55967-48f2-4f6f-a421-83a219d83f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:44:42.239776 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converting VIF {"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:42.240399 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:42.240929 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lazy-loading 'pci_devices' on Instance uuid 76e55967-48f2-4f6f-a421-83a219d83f2d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:42.529288 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,info_cache {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:42.743598 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] End _get_guest_xml xml=<domain type="qemu">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <uuid>76e55967-48f2-4f6f-a421-83a219d83f2d</uuid>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <name>instance-00000035</name>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumesActionsTest-instance-72008301</nova:name>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:44:42</nova:creationTime>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:user uuid="b22f01567d3c4627b6832a1715577c13">tempest-VolumesActionsTest-1771154880-project-member</nova:user>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:project uuid="0cf39e19ddaa4d198e5c04679478fb89">tempest-VolumesActionsTest-1771154880</nova:project>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         <nova:port uuid="22a31916-92e1-41f7-80e9-5be6328fbd64">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <system>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="serial">76e55967-48f2-4f6f-a421-83a219d83f2d</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="uuid">76e55967-48f2-4f6f-a421-83a219d83f2d</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </system>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <os>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </os>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <features>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </features>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   <devices>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.config"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:28:b4:81"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <target dev="tap22a31916-92"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </interface>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/console.log" append="off"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </serial>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <video>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </video>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </rng>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:   </devices>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]: </domain>
May 14 03:44:42.743598 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Preparing to wait for external event network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-72008301',display_name='tempest-VolumesActionsTest-instance-72008301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-72008301',id=53,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf39e19ddaa4d198e5c04679478fb89',ramdisk_id='',reservation_id='r-hmb0fv7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1771154880',owner_user_name='tempest-VolumesActionsTest-1771154880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:40Z,user_data=None,user_id='b22f01567d3c4627b6832a1715577c13',uuid=76e55967-48f2-4f6f-a421-83a219d83f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converting VIF {"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:42.745732 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:44:42.748894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.749149 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:42.749601 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:44:42.750242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.750490 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57295f1b-6dab-56a5-a534-a4d8555ae8b6', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:42.751748 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.752046 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:42.758993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.762827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.763022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22a31916-92, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:42.763474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22a31916-92, col_values=(('qos', UUID('3d825be0-d905-49a3-9fb7-5455c96df12b')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:42.763730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22a31916-92, col_values=(('external_ids', {'iface-id': '22a31916-92e1-41f7-80e9-5be6328fbd64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b4:81', 'vm-uuid': '76e55967-48f2-4f6f-a421-83a219d83f2d'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:42.768002 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.769037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:42.773861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.774738 np0000000741 nova-compute[97948]: INFO os_vif [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92')
May 14 03:44:42.929992 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:42.956660 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Creating image(s)
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:42.961659 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:42.965951 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:42.967401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:43.030607 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Successfully updated port: 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:44:43.032671 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:43.063267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:43.065390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:43.065390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:43.067438 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:43.076418 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:44:43.076418 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:43.115182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:43.115373 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing instance network info cache due to event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:43.117196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:43.117335 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:43.117540 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:43.177354 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:43.180025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:43.238856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk 1073741824" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:43.242656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:43.242656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:43.347520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:43.350510 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:44:43.350510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:43.445594 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:43.451580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Ensure instance console log exists: /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:43.453401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:43.537107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:43.598550 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:43.623903 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:43.701426 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:43.770988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:43.864218 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:44.100897 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-dc39231a-19ff-4111-91b3-0fb2c840da09" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:44.297975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:44.298118 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:44.298252 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] No VIF found with MAC fa:16:3e:28:b4:81, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:44.298778 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Using config drive
May 14 03:44:44.366401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1b275382-7944-4700-9458-99ad50b0e390 req-67311e48-e167-4b19-980a-4ce9062d20be service nova] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:44.367794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:44.367794 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:44:44.804582 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:44.973730 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Creating config drive at /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.config
May 14 03:44:44.976341 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:44:44.981349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp20kbt__j {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:45.044560 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp20kbt__j" returned: 0 in 0.063s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:45.119796 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance destroyed successfully.
May 14 03:44:45.123654 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'numa_topology' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:45.157675 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:45.319030 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:45.547427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.595943 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.597800 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.624774 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:45.625172 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:45.667152 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.822159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:45.822955 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance network_info: |[{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:44:45.824247 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start _get_guest_xml network_info=[{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:44:45.827692 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:44:45.828934 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='a2050a6c-1c7b-4454-8a7e-14960f06b79b'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730285.8283355) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:44:45.830143 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:44:45.831142 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:44:45.832291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:44:45.832291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:44:45.832848 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:44:45.833131 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:44:45.833269 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:44:45.833371 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:44:45.833474 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:44:45.833552 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:44:45.833675 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:44:45.834538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:44:45.834538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:44:45.834538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:44:45.834538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:44:45.834538 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:44:45.844899 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:44:45.845172 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:45.845781 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:45.847007 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:45.884011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.892090 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.894119 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:45.924391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.127306 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:46.128276 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:44:46.128520 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:46.129304 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:46.129688 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:44:46.131529 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.131827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8636c127-ac, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.132981 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.134563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:46.135553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.135681 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc1fd02f-6916-421e-8d5b-b45061a261a6) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.136113 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.136578 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:46.137017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.138912 np0000000741 nova-compute[97948]: INFO os_vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac')
May 14 03:44:46.141330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:44:46.141932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:46.142161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:46.348802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <uuid>a2050a6c-1c7b-4454-8a7e-14960f06b79b</uuid>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <name>instance-00000036</name>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-0</nova:name>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:44:45</nova:creationTime>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         <nova:port uuid="4b5f3126-9e98-4485-b87a-b6a8cee76119">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <system>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="serial">a2050a6c-1c7b-4454-8a7e-14960f06b79b</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="uuid">a2050a6c-1c7b-4454-8a7e-14960f06b79b</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </system>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <os>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </os>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <features>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </features>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   <devices>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:1c:30:f8"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <target dev="tap4b5f3126-9e"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </interface>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/console.log" append="off"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </serial>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <video>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </video>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </rng>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:   </devices>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]: </domain>
May 14 03:44:46.348802 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Preparing to wait for external event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:46.350587 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:46.351547 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:44:46.351997 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.352212 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.352394 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:44:46.353137 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.353280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '657c48e0-a667-56ee-bfc3-60be8f578b26', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.360936 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.361585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:46.362362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.363893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.364033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b5f3126-9e, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.364318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b5f3126-9e, col_values=(('qos', UUID('726a44a2-e88a-4820-a4d7-2c30a2173927')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.364463 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b5f3126-9e, col_values=(('external_ids', {'iface-id': '4b5f3126-9e98-4485-b87a-b6a8cee76119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:30:f8', 'vm-uuid': 'a2050a6c-1c7b-4454-8a7e-14960f06b79b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:46.365131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.366408 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:46.374499 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:46.376055 np0000000741 nova-compute[97948]: INFO os_vif [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e')
May 14 03:44:46.397805 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730286.3974319, 76e55967-48f2-4f6f-a421-83a219d83f2d => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:46.399043 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] VM Started (Lifecycle Event)
May 14 03:44:46.900728 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:46.903057 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730286.9027774, 76e55967-48f2-4f6f-a421-83a219d83f2d => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:46.903440 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] VM Paused (Lifecycle Event)
May 14 03:44:47.406067 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:47.407943 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:47.897984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:47.898182 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:47.898357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:1c:30:f8, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:47.898904 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Using config drive
May 14 03:44:47.912293 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:44:48.315933 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f69c2a9b-54e1-424f-a0b7-7074cd61270c req-aa63185a-308d-4e13-aeaf-e86e76540c32 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:48.317051 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f69c2a9b-54e1-424f-a0b7-7074cd61270c req-aa63185a-308d-4e13-aeaf-e86e76540c32 service nova] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:48.317598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f69c2a9b-54e1-424f-a0b7-7074cd61270c req-aa63185a-308d-4e13-aeaf-e86e76540c32 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:48.318251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f69c2a9b-54e1-424f-a0b7-7074cd61270c req-aa63185a-308d-4e13-aeaf-e86e76540c32 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:48.318488 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f69c2a9b-54e1-424f-a0b7-7074cd61270c req-aa63185a-308d-4e13-aeaf-e86e76540c32 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Processing event network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:44:48.319521 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:44:48.327117 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730288.3249793, 76e55967-48f2-4f6f-a421-83a219d83f2d => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:48.327117 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] VM Resumed (Lifecycle Event)
May 14 03:44:48.327117 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:44:48.331886 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance spawned successfully.
May 14 03:44:48.332291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:44:48.414141 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:48.589579 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Creating config drive at /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config
May 14 03:44:48.593884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppxbk3m_v {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:48.708958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppxbk3m_v" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:48.779110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:48.831337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:48.852330 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:48.855880 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:48.857063 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:48.859809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:48.859809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:48.859809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:48.859809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:49.246666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:49.278852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:49.281002 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:49.359856 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:44:49.368023 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Took 8.79 seconds to spawn the instance on the hypervisor.
May 14 03:44:49.368023 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:49.399191 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:49.426698 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:49.714158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.572s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:49.715096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:44:49.715390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:49.752737 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:49.753391 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de', '135')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:44:49.753391 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '124')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:49.754382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '125')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:44:49.755301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c60c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:44:49.755528 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:44:49.756034 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 3300000004f57b759 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:44:49.835385 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:49.890326 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Took 14.30 seconds to build instance.
May 14 03:44:49.901863 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:44:49.968388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:44:49.968388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:44:49.968388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:44:49.981008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:44:49.981417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:44:49.994394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.033394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260]
May 14 03:44:50.033394 np0000000741 nova-compute[97948]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260] successful.
May 14 03:44:50.033394 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.060287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.078894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.119905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260]
May 14 03:44:50.119905 np0000000741 nova-compute[97948]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260] successful.
May 14 03:44:50.119905 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.139133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.139974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:50.139974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (3998ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:50.139974 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:44:50.145995 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start _get_guest_xml network_info=[{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, 'status': 'reserved', 'instance': 'dc39231a-19ff-4111-91b3-0fb2c840da09', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'serial': 'c8d65405-8ecf-43d2-81b2-b975e59d500d'}, 'boot_index': 0, 'attachment_id': '4cafed8d-8a54-473f-8492-ea6a50423ba5', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:44:50.148421 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:44:50.149813 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1670587843', uuid='dc39231a-19ff-4111-91b3-0fb2c840da09'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730290.1493287) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:44:50.151202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:44:50.151202 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:44:50.154981 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:50.258791 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730290.258322, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:50.259063 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Started (Lifecycle Event)
May 14 03:44:50.393214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.810s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:50.410048 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] No waiting events found dispatching network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received unexpected event network-vif-plugged-22a31916-92e1-41f7-80e9-5be6328fbd64 for instance with vm_state active and task_state None.
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Processing event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:50.414749 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-07693061-b823-442f-9471-c313cefa2b05 req-a3b13c25-bfee-41ad-8807-9d370112e12a service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received unexpected event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with vm_state building and task_state spawning.
May 14 03:44:50.420566 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:44:50.424613 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance spawned successfully.
May 14 03:44:50.426037 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:44:50.659692 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:50.674631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:50.766212 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:50.775241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:50.784676 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:44:50.785829 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:50.788831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:44:50.805275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:50.806384 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:50.806918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:50.807163 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:50.807450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:50.807656 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:50.822124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:50.822124 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.830777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:50.830777 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.836975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d] added
May 14 03:44:50.836975 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:50.836975 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:50.836975 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:50.836975 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:50.836975 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:50.836975 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.837159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:50.837420 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:50.837566 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:50.847490 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d] added
May 14 03:44:50.847490 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:50.847490 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:50.847490 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:50.847490 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:50.847490 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:50.847490 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:50.847738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:50.848243 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:50.848243 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:50.943244 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:50.943429 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:50.943719 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:50.943964 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:50.944248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:50.944524 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:44:51.280312 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:44:51.280727 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730291.2804863, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:51.280881 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Paused (Lifecycle Event)
May 14 03:44:51.366786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:51.450076 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Took 8.49 seconds to spawn the instance on the hypervisor.
May 14 03:44:51.450223 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:51.783766 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:51.786497 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730291.7861242, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:51.786665 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Resumed (Lifecycle Event)
May 14 03:44:51.840209 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:51.848765 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:51.868078 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:51.868078 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:51.882347 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:51.882347 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.890609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.898954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:51.914021 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:51.914396 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:51.920812 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:51.966951 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Took 14.40 seconds to build instance.
May 14 03:44:51.972012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260]
May 14 03:44:51.972012 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260] successful.
May 14 03:44:51.972012 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.983570 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260]
May 14 03:44:51.983570 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260] successful.
May 14 03:44:51.983570 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:51.989895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:52.001014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.018297 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.018621 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:52.018919 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:52.019080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:52.020216 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('10', '-', '-', 0) found on session 136 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:52.020337 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:52.052012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.071538 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:52.073664 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.265s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:52.073664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:52.074325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('11', '-', '-', 0) found on session 137 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:52.074540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:52.100138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 137 and hctl ['11', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:52.293903 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:52.298133 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:52.474763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.911s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:53.052620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:53.053099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:53.101375 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 137 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:53.101835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:53.782175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:53.783605 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007599189998472866 future=<Future at 0x79d0907481d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:53.783605 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:53.784279 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] Emitting event <LifecycleEvent: 1778730278.78171, dc39231a-19ff-4111-91b3-0fb2c840da09 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:53.784510 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Stopped (Lifecycle Event)
May 14 03:44:53.808345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:44:53.993864 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:53.993960 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing instance network info cache due to event network-changed-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:53.994190 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] Acquiring lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:53.994330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] Acquired lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:53.994520 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Refreshing network info cache for port 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:54.287779 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-33657342-92e5-43e4-9569-73a0e3ac78ad tempest-TestServerVolumeAttachmentScenario-742934758 tempest-TestServerVolumeAttachmentScenario-742934758-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:54.498551 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:54.834940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 3300000004f57b759 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:44:54.834940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:54.834940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (4046ms) {'type': 'block', 'scsi_wwn': '3300000004f57b759', 'path': '/dev/dm-0', 'multipath_id': '3300000004f57b759'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:54.834940 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f57b759', 'path': '/dev/dm-0', 'multipath_id': '3300000004f57b759'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:44:54.903093 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:55.029346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:55.031585 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:55.115982 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updated VIF entry in instance network info cache for port 697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:55.120085 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating instance_info_cache with network_info: [{"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:55.347227 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:44:55.347227 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:55.347227 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:55.347227 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:55.414463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:55.414463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:55.536182 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:55.625476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41d147ee-514c-459d-b95f-ed34f09a284a req-df40ae2f-9e21-47b3-8a69-2cb31b092ad9 service nova] Releasing lock "refresh_cache-85c0d018-04a6-4eeb-94c7-73c7077c43f1" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:55.852146 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Object Instance<dc39231a-19ff-4111-91b3-0fb2c840da09> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:44:55.854659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] End _get_guest_xml xml=<domain type="qemu">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <uuid>dc39231a-19ff-4111-91b3-0fb2c840da09</uuid>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <name>instance-00000032</name>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-1670587843</nova:name>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:44:50</nova:creationTime>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         <nova:port uuid="8636c127-acb2-416b-a186-dd15447942af">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <system>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="serial">dc39231a-19ff-4111-91b3-0fb2c840da09</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="uuid">dc39231a-19ff-4111-91b3-0fb2c840da09</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </system>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <os>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </os>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <features>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </features>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   <devices>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/disk.config"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <alias name="ua-c8d65405-8ecf-43d2-81b2-b975e59d500d"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <serial>c8d65405-8ecf-43d2-81b2-b975e59d500d</serial>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </disk>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:3a:ab:ca"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <target dev="tap8636c127-ac"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </interface>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09/console.log" append="off"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </serial>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <video>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </video>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </rng>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:   </devices>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]: </domain>
May 14 03:44:55.854659 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:44:55.854659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:55.857447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3ea95f-45bd-5302-826b-585ad6251d39', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8636c127-ac, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:55.864436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8636c127-ac, col_values=(('qos', UUID('348228c0-6d4a-4805-9f31-575b7c6a8966')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:55.864678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8636c127-ac, col_values=(('external_ids', {'iface-id': '8636c127-acb2-416b-a186-dd15447942af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ab:ca', 'vm-uuid': 'dc39231a-19ff-4111-91b3-0fb2c840da09'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:55.868844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:55.879345 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:55.880362 np0000000741 nova-compute[97948]: INFO os_vif [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac')
May 14 03:44:55.915748 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:44:56.079205 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:56.079349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing instance network info cache due to event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:44:56.079799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:44:56.079974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:44:56.080375 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:44:56.410709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.444928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.501770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:56.501883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:56.513986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:44:56.514128 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Claim successful on node np0000000741
May 14 03:44:56.542850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.546205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:56.603350 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:56.691888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:56.691888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:56.691888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:56.691888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:56.692257 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:56.692257 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-02f82d7f-53c2-40c3-8181-ea0191e9b0bc req-48f1afa0-77d6-4515-a618-ab3edb6ccc23 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state stopped and task_state powering-on.
May 14 03:44:56.697153 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:56.700421 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:56.700421 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:56.700421 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:56.700604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:56.711872 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Terminating instance
May 14 03:44:56.789446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.797514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.822670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:56.824819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.169376 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:57.231496 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:44:57.256320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.265075 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.279948 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.285020 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.307921 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.313494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.362889 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updated VIF entry in instance network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:44:57.363265 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:57.432964 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730297.431309, dc39231a-19ff-4111-91b3-0fb2c840da09 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:57.432964 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Resumed (Lifecycle Event)
May 14 03:44:57.433536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:44:57.452767 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance rebooted successfully.
May 14 03:44:57.563476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.581718 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:57.607958 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Instance destroyed successfully.
May 14 03:44:57.608412 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lazy-loading 'resources' on Instance uuid 76e55967-48f2-4f6f-a421-83a219d83f2d {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:44:57.816179 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:57.816597 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:57.816597 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attaching volume e12ff900-b1c8-42c3-beff-fc0d7919f513 to /dev/vdb
May 14 03:44:57.868272 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5ced4214-e4aa-4d80-9af3-02d01bfd120f req-126ae81e-df81-4961-8196-59b6eb6f4a83 service nova] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:44:57.879396 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:57.903475 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:44:57.935678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:44:57.954739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:57.976426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:57.995924 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:44:57.996373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:44:58.007656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:44:58.009112 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fe3a:abca', 'fe80::14cb:8fff:fe43:ccbf'] 
May 14 03:44:58.009918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:44:58.009918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:44:58.009918 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:44:58.010130 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating existing volume attachment record: a030828c-87dd-4d16-9497-c9d31e05ba7e {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:44:58.100525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:44:58.100987 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:44:58.118449 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-72008301',display_name='tempest-VolumesActionsTest-instance-72008301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumesactionstest-instance-72008301',id=53,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:44:49Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf39e19ddaa4d198e5c04679478fb89',ramdisk_id='',reservation_id='r-hmb0fv7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1771154880',owner_user_name='tempest-VolumesActionsTest-1771154880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:49Z,user_data=None,user_id='b22f01567d3c4627b6832a1715577c13',uuid=76e55967-48f2-4f6f-a421-83a219d83f2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:44:58.121434 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converting VIF {"id": "22a31916-92e1-41f7-80e9-5be6328fbd64", "address": "fa:16:3e:28:b4:81", "network": {"id": "7c88413a-c5c0-47ea-b57f-46819f824013", "bridge": "br-int", "label": "tempest-VolumesActionsTest-909541716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cf39e19ddaa4d198e5c04679478fb89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a31916-92", "ovs_interfaceid": "22a31916-92e1-41f7-80e9-5be6328fbd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:44:58.121434 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:44:58.122264 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:44:58.125722 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:58.125722 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22a31916-92, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:58.127513 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:58.128739 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:58.128986 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d825be0-d905-49a3-9fb7-5455c96df12b) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:44:58.130758 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:44:58.137285 np0000000741 nova-compute[97948]: INFO os_vif [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b4:81,bridge_name='br-int',has_traffic_filtering=True,id=22a31916-92e1-41f7-80e9-5be6328fbd64,network=Network(7c88413a-c5c0-47ea-b57f-46819f824013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a31916-92')
May 14 03:44:58.137892 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Deleting instance files /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d_del
May 14 03:44:58.138703 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Deletion of /opt/stack/data/nova/instances/76e55967-48f2-4f6f-a421-83a219d83f2d_del complete
May 14 03:44:58.480024 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:44:58.480546 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730298.480132, dc39231a-19ff-4111-91b3-0fb2c840da09 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:44:58.480546 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Started (Lifecycle Event)
May 14 03:44:58.566903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:44:58.567324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:44:58.567574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:58.568103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:58.568351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:44:58.582854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:58.583633 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:44:58.584429 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:58.584609 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:58.585089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:44:58.585341 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:58.601916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:58.601916 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:58.604144 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:44:58.610694 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:44:58.610694 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:58.622398 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513] added
May 14 03:44:58.622398 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:58.622398 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:58.622398 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:58.622398 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:58.622398 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:58.622398 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:58.622930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:58.622930 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:58.623053 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:58.625306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513] added
May 14 03:44:58.625306 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:44:58.625306 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:58.625306 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:58.625306 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:44:58.625306 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:44:58.625306 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:58.625901 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:44:58.626223 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:44:58.628387 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:44:58.650855 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Took 1.42 seconds to destroy the instance on the hypervisor.
May 14 03:44:58.651775 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:44:58.652223 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:44:58.652370 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:44:58.652675 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:58.770172 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:58.780482 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:58.781981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:58.782235 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:58.782494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:58.783954 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:58.784806 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state stopped and task_state powering-on.
May 14 03:44:58.784949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:58.785215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:44:58.787514 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:58.787998 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:58.788226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:58.788742 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] No waiting events found dispatching network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:58.788908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:44:58.789087 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:44:58.789979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Acquiring lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:44:58.789979 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:44:58.790226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:58.790281 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] No waiting events found dispatching network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:44:58.790411 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-63d8f728-9558-4d95-ba47-6cea214e1b4e req-517db42c-04ee-4fcd-91bc-127f445a4304 service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-unplugged-22a31916-92e1-41f7-80e9-5be6328fbd64 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:44:58.985937 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:58.990464 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:58.990616 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:44:58.990783 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:3a:ab:ca, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:44:58.990783 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:44:58.994147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6abc47a2-c182-4fc5-8344-3051b74e159a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:44:59.117005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.615s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:44:59.118208 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:44:59.436868 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-149511bc-db24-402e-8185-730df086146a tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Get console output
May 14 03:44:59.440960 np0000000741 nova-compute[97948]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 14 03:44:59.495269 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 03:44:59.495269 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999655734999578 future=<Future at 0x79d0b82ac230 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:59.495631 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999276364999787 future=<Future at 0x79d0b82ac230 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:59.496371 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999150242999804 future=<Future at 0x79d0b82ac230 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:44:59.624132 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:44:59.631138 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:44:59.631385 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:44:59.632261 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:44:59.635120 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:59.635528 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:44:59.635751 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:59.660003 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:59.660003 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:44:59.663552 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:44:59.663552 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.679282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.693484 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.704950 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.705264 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.717697 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.718169 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:59.742167 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:44:59.761389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.40.100,3260]
May 14 03:44:59.761389 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.40.100,3260] successful.
May 14 03:44:59.761389 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.775426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.783121 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.50.100,3260]
May 14 03:44:59.783121 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.50.100,3260] successful.
May 14 03:44:59.783121 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.797148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.803183 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:59.804036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:59.804036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:59.805099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('12', '-', '-', 0) found on session 138 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:59.805099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.817351 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94e2f3a0-e207-4aa3-8655-b28e182890e6 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:44:59.817775 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:44:59.818142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:44:59.818142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:44:59.819197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('17', '-', '-', 0) found on session 139 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:44:59.819364 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:44:59.837347 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 138 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:59.837682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:44:59.845874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 139 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:44:59.846069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:00.134849 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Took 1.48 seconds to deallocate network for instance.
May 14 03:45:00.136206 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:45:00.178301 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:00.424318 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Successfully created port: 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:45:00.585734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:00.649113 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:45:00.654363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:00.654592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:00.880219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-16df34e9-1b32-4896-9007-cee84f66efb6 req-cfc76f05-dbbe-4218-9dc4-6c641c4a301e service nova] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Received event network-vif-deleted-22a31916-92e1-41f7-80e9-5be6328fbd64 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:01.112409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Successfully updated port: 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:45:01.173886 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:01.176868 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:01.603019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found WWN 3300000009e9820e1 for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:01.603620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:01.603620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000009e9820e1', 'path': '/dev/dm-6', 'multipath_id': '3300000009e9820e1'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:01.603620 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009e9820e1', 'path': '/dev/dm-6', 'multipath_id': '3300000009e9820e1'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:01.605913 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:01.617376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:01.617513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:01.617661 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:01.666669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:01.666669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:01.666669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:01.666917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:01.667054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:01.676807 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:45:01.678257 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:45:01.680223 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:01.686078 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Terminating instance
May 14 03:45:01.689690 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Creating image(s)
May 14 03:45:01.690338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:01.690517 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:01.695413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:01.696886 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:01.705989 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:01.708697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:01.839755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.132s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:01.840324 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:01.843981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:01.843981 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:01.848797 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:01.852183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:01.981715 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.129s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:01.983661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:02.047277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk 1073741824" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:02.047845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:02.048305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:02.111662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attempting to attach volume e12ff900-b1c8-42c3-beff-fc0d7919f513 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:45:02.115062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:   <alias name="ua-e12ff900-b1c8-42c3-beff-fc0d7919f513"/>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:   <serial>e12ff900-b1c8-42c3-beff-fc0d7919f513</serial>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:02.115062 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:45:02.153228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:02.154110 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:45:02.154110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:02.204594 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:45:02.208528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.554s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:02.247736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.264532 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:02.277144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.290915 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Deleted allocations for instance 76e55967-48f2-4f6f-a421-83a219d83f2d
May 14 03:45:02.296289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:02.300237 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:45:02.300543 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:45:02.300752 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Ensure instance console log exists: /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:45:02.301155 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:02.301394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:02.301517 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:02.307824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.307824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.533537 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:02.556082 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.592139 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999545523000052 future=<Future at 0x79d0b046ad80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:02.599541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.603348 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Instance destroyed successfully.
May 14 03:45:02.604021 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid dc39231a-19ff-4111-91b3-0fb2c840da09 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:02.618769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.872271 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:02.953186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:02.953322 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing instance network info cache due to event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:02.953458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:02.961603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.971898 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:02.974159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.006082 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.110705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1670587843',display_name='tempest-TestVolumeBootPattern-server-1670587843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1670587843',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpBfzGAgXOdhlXiyK9CV8bXOvlVQzOwGhGnUjCI9Xzung8+uGgL3tBJk2wrb8/stfaI2GRyEWHWA2BlthG1cFRaYDbWe4f8kmUYOJDci7honGr1p5FN/10GGvQVjVkVA==',key_name='tempest-keypair-586771820',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-lwi1pee7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=dc39231a-19ff-4111-91b3-0fb2c840da09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:45:03.110705 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "8636c127-acb2-416b-a186-dd15447942af", "address": "fa:16:3e:3a:ab:ca", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8636c127-ac", "ovs_interfaceid": "8636c127-acb2-416b-a186-dd15447942af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:03.110705 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:03.111321 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:45:03.113316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.114785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8636c127-ac, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.123128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:03.125901 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.127663 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=348228c0-6d4a-4805-9f31-575b7c6a8966) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.131491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.136651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:03.144174 np0000000741 nova-compute[97948]: INFO os_vif [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:ca,bridge_name='br-int',has_traffic_filtering=True,id=8636c127-acb2-416b-a186-dd15447942af,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8636c127-ac')
May 14 03:45:03.145296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:45:03.147190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:03.147190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:03.147190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:03.147190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8d65405-8ecf-43d2-81b2-b975e59d500d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:45:03.147190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:45:03.173405 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:03.182931 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611 (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:03.184369 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c478e68a-8ef0-43a3-bc3b-329d189ef611', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f42c58b-7225-4ecb-9a61-4630cec487de', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '139')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:45:03.184369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '136')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:03.184680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d', '137')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:03.185258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b85fb420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:45:03.185411 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdf, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:45:03.185608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 3300000004f57b759 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:45:03.252775 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:03.305662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:03.308882 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f28abd62-6bf7-4737-9b54-2682fb7c6558 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Lock "76e55967-48f2-4f6f-a421-83a219d83f2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.611s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:03.347732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:45:03.348265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:45:03.349831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:45:03.363444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:45:03.363444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:45:03.375277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:03.375554 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance network_info: |[{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:45:03.376362 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:03.379231 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:03.380076 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start _get_guest_xml network_info=[{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:45:03.380505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.386786 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:03.388622 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='608384f9-6f6b-428e-a519-f1631dc5deb2'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730303.3879728) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:45:03.390042 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:45:03.390760 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:45:03.391800 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:45:03.391981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:45:03.393085 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:45:03.393461 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:45:03.393881 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:45:03.394022 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:45:03.394176 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:45:03.394277 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:45:03.394385 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:45:03.394567 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:45:03.394717 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:45:03.394854 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:45:03.395060 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:45:03.395126 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:45:03.410269 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:45:03.410496 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:03.411066 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:03.411704 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:03.428121 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260]
May 14 03:45:03.428121 np0000000741 nova-compute[97948]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.40.100,3260] successful.
May 14 03:45:03.428121 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.448476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.465311 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.508180 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260]
May 14 03:45:03.508180 np0000000741 nova-compute[97948]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-c8d65405-8ecf-43d2-81b2-b975e59d500d, portal: 192.168.50.100,3260] successful.
May 14 03:45:03.508180 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.529213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:03.529213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:03.529213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (383ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:03.529213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:45:03.529431 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Deleting instance files /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09_del
May 14 03:45:03.532766 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Deletion of /opt/stack/data/nova/instances/dc39231a-19ff-4111-91b3-0fb2c840da09_del complete
May 14 03:45:03.784903 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.813582 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:03.813829 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:03.814070 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:03.814234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No VIF found with MAC fa:16:3e:db:05:39, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:03.881499 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:03.915529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] End _get_guest_xml xml=<domain type="qemu">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <uuid>608384f9-6f6b-428e-a519-f1631dc5deb2</uuid>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <name>instance-00000037</name>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-1</nova:name>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:45:03</nova:creationTime>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         <nova:port uuid="5f9133ed-acb2-4f3e-b080-6e9b9aaea794">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <system>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="serial">608384f9-6f6b-428e-a519-f1631dc5deb2</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="uuid">608384f9-6f6b-428e-a519-f1631dc5deb2</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </system>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <os>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </os>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <features>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </features>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   <devices>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:cc:f5:61"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <target dev="tap5f9133ed-ac"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </interface>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/console.log" append="off"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </serial>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <video>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </video>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </rng>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:   </devices>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]: </domain>
May 14 03:45:03.915529 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Preparing to wait for external event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.922273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b42557e8-8e55-53f6-ad5b-3767de18d5a6', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.924079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.925001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:03.925692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.930808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.930808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9133ed-ac, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.930808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f9133ed-ac, col_values=(('qos', UUID('5b86df82-4887-4937-9d5c-f2ef095f814d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.930808 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f9133ed-ac, col_values=(('external_ids', {'iface-id': '5f9133ed-acb2-4f3e-b080-6e9b9aaea794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f5:61', 'vm-uuid': '608384f9-6f6b-428e-a519-f1631dc5deb2'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:03.932826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.933260 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:03.939631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:03.942214 np0000000741 nova-compute[97948]: INFO os_vif [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac')
May 14 03:45:04.042214 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Took 1.84 seconds to destroy the instance on the hypervisor.
May 14 03:45:04.042474 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:45:04.042795 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:45:04.042943 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:45:04.043374 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:04.191294 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:04.417013 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:04.631529 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updated VIF entry in instance network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:04.632016 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:04.841293 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70d255ea-1b3e-4d14-9e46-3d81fa199567 req-923e2946-e92b-4176-a0ad-98d6267ad07c service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-deleted-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:04.841687 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-70d255ea-1b3e-4d14-9e46-3d81fa199567 req-923e2946-e92b-4176-a0ad-98d6267ad07c service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Neutron deleted interface 8636c127-acb2-416b-a186-dd15447942af; detaching it from the instance and deleting it from the info cache
May 14 03:45:04.841687 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70d255ea-1b3e-4d14-9e46-3d81fa199567 req-923e2946-e92b-4176-a0ad-98d6267ad07c service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:05.035363 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.035770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.036067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.036337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.036534 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.036768 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state active and task_state deleting.
May 14 03:45:05.037131 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.037472 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.039714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6859f916-2bbe-46f7-bad2-408c7c262e5a req-93b9fd8b-a7be-4516-b2d9-bd6a0c23fcb2 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:05.136394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:05.136714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.137006 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.138117 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.138515 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.138633 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-unplugged-8636c127-acb2-416b-a186-dd15447942af for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:05.138804 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:05.139052 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Acquiring lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.139228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.139372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.139534 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] No waiting events found dispatching network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:05.139947 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e999595a-be28-4f70-9d0e-022e7460be8b req-fd8c785f-7f93-4d40-b4f4-2870d0f35d63 service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Received unexpected event network-vif-plugged-8636c127-acb2-416b-a186-dd15447942af for instance with vm_state active and task_state deleting.
May 14 03:45:05.303840 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:05.345801 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70d255ea-1b3e-4d14-9e46-3d81fa199567 req-923e2946-e92b-4176-a0ad-98d6267ad07c service nova] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Detach interface failed, port_id=8636c127-acb2-416b-a186-dd15447942af, reason: Instance dc39231a-19ff-4111-91b3-0fb2c840da09 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:45:05.386770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-313d79ee-29d9-4d03-965f-7cab1a00299d tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:05.466312 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:05.466855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:05.466855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:cc:f5:61, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:05.468667 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Using config drive
May 14 03:45:05.806999 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Took 1.76 seconds to deallocate network for instance.
May 14 03:45:05.955145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:05.955653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:05.973255 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:06.110689 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Creating config drive at /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config
May 14 03:45:06.116021 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9osktpcb {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:06.191719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9osktpcb" returned: 0 in 0.075s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:06.367178 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:45:06.461986 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:06.693157 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:06.723146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:06.820578 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:06.839205 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:06.840350 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:06.874361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:06.874361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:06.934342 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e5b89d5-9e41-4b02-8b2f-719930bac1b7 req-2c88a5e5-7d3e-4b9e-9430-341e458565e8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:06.934342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e5b89d5-9e41-4b02-8b2f-719930bac1b7 req-2c88a5e5-7d3e-4b9e-9430-341e458565e8 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:06.934483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e5b89d5-9e41-4b02-8b2f-719930bac1b7 req-2c88a5e5-7d3e-4b9e-9430-341e458565e8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:06.934706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7e5b89d5-9e41-4b02-8b2f-719930bac1b7 req-2c88a5e5-7d3e-4b9e-9430-341e458565e8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:06.934863 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7e5b89d5-9e41-4b02-8b2f-719930bac1b7 req-2c88a5e5-7d3e-4b9e-9430-341e458565e8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Processing event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:45:07.377510 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:07.378003 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:07.470494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:07.648196 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:45:07.652669 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730307.6490984, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:07.652669 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Started (Lifecycle Event)
May 14 03:45:07.652669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:45:07.660656 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance spawned successfully.
May 14 03:45:07.660656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:45:07.881052 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:08.154946 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:08.158344 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:08.176117 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.176263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.176696 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.176997 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.177330 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.177844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:08.389159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.515s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:08.437448 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance dc39231a-19ff-4111-91b3-0fb2c840da09
May 14 03:45:08.581292 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:08.581469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:08.581748 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attaching volume f22f1200-9c5e-49ed-a36f-c9651e0e2f0a to /dev/vdc
May 14 03:45:08.620323 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:08.631051 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:08.652616 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:08.666898 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:45:08.669197 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730308.6680717, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:08.669197 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Paused (Lifecycle Event)
May 14 03:45:08.693097 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Took 7.01 seconds to spawn the instance on the hypervisor.
May 14 03:45:08.693220 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:08.717003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:08.717222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:08.724922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:08.727628 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fecc:f561'] 
May 14 03:45:08.727899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:08.728092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:08.728299 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:08.728515 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating existing volume attachment record: 9df944ad-2cfc-46b3-867a-1f4ed5ecf4bb {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:45:08.786054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:08.936077 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:09.007602 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:09.009200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:09.009200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:09.009200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:09.009200 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:09.009200 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-bb62f878-2884-45e5-b126-97fbafeed8e9 req-41f41daa-f3d0-4c8d-8d22-4be309700b42 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received unexpected event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with vm_state active and task_state None.
May 14 03:45:09.173782 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:09.176812 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730309.1764655, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:09.177041 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Resumed (Lifecycle Event)
May 14 03:45:09.213421 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Took 12.79 seconds to build instance.
May 14 03:45:09.296433 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:09.297027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:09.297151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:09.297478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:09.297683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:09.313627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:09.314532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:09.315025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:09.315250 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:09.315867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:09.316210 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:09.326926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:09.326926 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:09.334167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:09.334167 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:09.343533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a] added
May 14 03:45:09.343533 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:09.343533 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:09.343533 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:09.343533 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:09.343533 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:09.343533 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:09.343806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:09.344289 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:09.344476 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:09.347900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a] added
May 14 03:45:09.347900 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:09.347900 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:09.347900 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:09.347900 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:09.347900 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:09.347900 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:09.348068 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:09.348264 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:09.348422 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:09.447265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-10fbf0f5-aaf3-429f-9c31-0497776e54e3 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "dc39231a-19ff-4111-91b3-0fb2c840da09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.781s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:09.679762 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:09.681908 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:09.716073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.302s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:10.345358 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:10.349253 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:10.365237 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:10.365237 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:10.368397 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:10.368397 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.381726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.388671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.403071 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.403357 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.409680 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:10.453450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.50.100,3260]
May 14 03:45:10.453450 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.50.100,3260] successful.
May 14 03:45:10.453450 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.463440 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.40.100,3260]
May 14 03:45:10.463440 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.40.100,3260] successful.
May 14 03:45:10.463440 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.472580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.484283 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.506244 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.506680 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:10.506680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:10.507055 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.507614 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:10.508556 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:10.509130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:10.509130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:10.512382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('7', '-', '-', 0) found on session 140 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:10.512382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:10.512382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] HCTL ('8', '-', '-', 0) found on session 141 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:10.512382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:10.536368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 141 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:10.536368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:10.542558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Searching for a device in session 140 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:10.542558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:10.571435 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:10.571435 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing instance network info cache due to event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:10.571558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:10.571727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:10.571727 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:11.075153 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:11.315294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:11.409331 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:11.576110 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updated VIF entry in instance network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:11.576600 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:12.078473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-10cfe927-c083-4c94-a613-362f4c2fb685 req-988f5b6f-435c-4fb6-af63-62bdac20a37c service nova] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:12.339367 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found WWN 330000000ed0081d6 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:12.339749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:12.339984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000ed0081d6', 'path': '/dev/dm-0', 'multipath_id': '330000000ed0081d6'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:12.340148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed0081d6', 'path': '/dev/dm-0', 'multipath_id': '330000000ed0081d6'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:12.354739 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:12.367374 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:12.367819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:12.637050 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:12.637347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing instance network info cache due to event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:12.637347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:12.637465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:12.637465 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:12.857243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attempting to attach volume f22f1200-9c5e-49ed-a36f-c9651e0e2f0a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:45:12.858452 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:   <alias name="ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a"/>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:   <serial>f22f1200-9c5e-49ed-a36f-c9651e0e2f0a</serial>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:12.858452 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:45:12.871189 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:13.141019 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:13.561115 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:13.708206 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updated VIF entry in instance network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:13.708631 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:13.787805 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:13.881965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:13.938084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:14.215191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b66cf47c-532f-4ab7-86fe-932e5e44bf42 req-e322817d-bce6-4759-8aad-c0aa4f8e3086 service nova] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:14.495309 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00040414200020677526 future=<Future at 0x79d0b82ac230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:14.495472 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:14.495526 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.0947146870003053 future=<Future at 0x79d0b046ad80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:14.495659 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.0945998950001012 future=<Future at 0x79d0b046ad80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:14.495971 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730299.494782, 76e55967-48f2-4f6f-a421-83a219d83f2d => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:14.496129 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] VM Stopped (Lifecycle Event)
May 14 03:45:14.540468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:14.540588 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:14.540722 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:14.540855 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:14.541675 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] No VIF found with MAC fa:16:3e:db:05:39, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:15.002776 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-13ebede5-8f28-4117-8357-ed97917f7796 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 76e55967-48f2-4f6f-a421-83a219d83f2d] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:15.048928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:15.049092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:15.049307 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attaching volume 68afeadc-26f9-4d0e-a964-e15575723cb9 to /dev/vdb
May 14 03:45:15.111554 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:15.128735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:15.153503 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:15.197604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:15.198001 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:15.209884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:15.211046 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fecc:f561'] 
May 14 03:45:15.211125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:15.211209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:15.211521 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:15.211890 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating existing volume attachment record: bc2589a3-f699-4e5f-a3ea-1f68cd7ff45f {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:45:15.494810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:15.494810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:15.767458 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:15.767829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:15.767989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:15.768414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:15.768614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:15.781810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:15.782615 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:15.782869 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:15.783344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:15.784077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:15.784293 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:15.793830 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:15.793830 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:15.798833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:15.798833 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:15.806270 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9] added
May 14 03:45:15.806270 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:15.806270 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:15.806270 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:15.806270 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:15.806270 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:15.806270 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:15.806594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:15.806703 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:15.806945 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:15.809204 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9] added
May 14 03:45:15.809204 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:15.809204 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:15.809204 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:15.809204 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:15.809204 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:15.809204 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:15.809442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:15.809571 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:15.809853 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:15.997118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:45:16.111922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4cc221f8-9f1b-4e53-af18-a0a2cb3dd63b tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.530s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:16.574211 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:16.574350 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:16.578357 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:16.578357 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Claim successful on node np0000000741
May 14 03:45:16.807507 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:16.810373 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:16.823527 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:16.823527 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:16.836652 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:16.836652 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.841656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.856962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.868176 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.881113 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.881407 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:16.937290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.50.100,3260]
May 14 03:45:16.937290 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.50.100,3260] successful.
May 14 03:45:16.937290 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.941520 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.40.100,3260]
May 14 03:45:16.941520 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.40.100,3260] successful.
May 14 03:45:16.941520 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.966848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.973476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.990838 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.991422 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:16.991422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:16.991964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:16.994462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('10', '-', '-', 0) found on session 143 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:16.994462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:16.995067 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:16.997262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:16.997262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:16.997262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('11', '-', '-', 0) found on session 144 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:16.997262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:17.021256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 143 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:17.021256 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:17.025956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 144 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:17.025956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:17.595258 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00495219200001884 future=<Future at 0x79d0b046ad80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:17.595767 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:17.601002 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730302.5901558, dc39231a-19ff-4111-91b3-0fb2c840da09 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:17.601101 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] VM Stopped (Lifecycle Event)
May 14 03:45:17.784971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:18.062056 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:18.062306 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:18.106773 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: dc39231a-19ff-4111-91b3-0fb2c840da09] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:18.418935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:18.566261 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:18.790307 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:18.803553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 33000000064d1fb5e for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:18.803553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:18.803553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:18.803735 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:18.807693 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:18.938830 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:19.073493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.499s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:19.073902 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:45:19.312833 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attempting to attach volume 68afeadc-26f9-4d0e-a964-e15575723cb9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:45:19.314361 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:19.314361 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:45:19.585493 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:45:19.585805 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:45:19.586485 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:19.586580 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:19.656452 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:45:19.783914 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:19.784080 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 03:45:20.090739 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:45:20.183076 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Successfully created port: a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:45:20.287024 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] There are 0 instances to clean {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 03:45:20.287236 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:20.536502 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:20.594271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:45:20.942268 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Successfully updated port: a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:45:20.997983 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:20.998216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:20.998367 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:20.998497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:1c:30:f8, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:21.013177 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-changed-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:21.016401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Refreshing instance network info cache due to event network-changed-a766843f-4d54-450e-a6c8-9f3fa906c70d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:21.016612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] Acquiring lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:21.016782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] Acquired lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:21.016904 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Refreshing network info cache for port a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:21.099781 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Booting with volume snapshot e2f4ff61-c6a6-4642-8860-5d8ee44bfb28 at /dev/vda
May 14 03:45:21.446446 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:21.520194 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:21.650974 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:21.838333 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:22.164763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:22.165219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:22.286755 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:22.287109 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:22.342061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8b868e96-e5ad-4663-a7c9-1717c02b02b1 req-e3f8f69a-6403-410a-8197-408683c543ed service nova] Releasing lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:22.343507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:22.343507 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:22.394165 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:22.394317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:22.566518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-35c2ef53-cb26-4317-bb33-69aac806cb67 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.517s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:22.669869 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Detaching volume e12ff900-b1c8-42c3-beff-fc0d7919f513
May 14 03:45:22.716192 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attempting to driver detach volume e12ff900-b1c8-42c3-beff-fc0d7919f513 from mountpoint /dev/vdb
May 14 03:45:22.722052 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found disk vdb by alias ua-e12ff900-b1c8-42c3-beff-fc0d7919f513 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:45:22.723477 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found disk vdb by alias ua-e12ff900-b1c8-42c3-beff-fc0d7919f513 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:45:22.723656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Attempting to detach device vdb from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:45:22.723956 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <alias name="ua-e12ff900-b1c8-42c3-beff-fc0d7919f513"/>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <serial>e12ff900-b1c8-42c3-beff-fc0d7919f513</serial>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:22.723956 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:45:22.733427 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully detached device vdb from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the persistent domain config.
May 14 03:45:22.733631 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] (1/8): Attempting to detach device vdb with device alias ua-e12ff900-b1c8-42c3-beff-fc0d7919f513 from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:45:22.733996 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <alias name="ua-e12ff900-b1c8-42c3-beff-fc0d7919f513"/>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <serial>e12ff900-b1c8-42c3-beff-fc0d7919f513</serial>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:22.733996 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:45:22.898109 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:22.927112 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:23.182333 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:23.316887 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730323.315011, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => ua-e12ff900-b1c8-42c3-beff-fc0d7919f513> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:45:23.317104 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e12ff900-b1c8-42c3-beff-fc0d7919f513 for instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:45:23.319313 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully detached device vdb from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the live domain config.
May 14 03:45:23.320615 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:45:23.320927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:23.321086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:23.321463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:23.321795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e12ff900-b1c8-42c3-beff-fc0d7919f513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:45:23.321966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:45:23.355831 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Updating instance_info_cache with network_info: [{"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:23.356801 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:23.357521 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:45:23.357521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '138')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:23.358953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513', '139')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:23.359831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c1120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'): ({'sdl'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:45:23.360017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Removing multipathed devices sdl, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:45:23.360268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Flush multipath device 3300000009e9820e1 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:45:23.396754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:23.441217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:23.484830 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if SCSI volumes sdl, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:45:23.485070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] SCSI volumes sdl, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:45:23.486770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if device paths {'sdl', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:45:23.500768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Device paths {'sdl', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:45:23.501073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:45:23.522195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.567490 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.40.100,3260]
May 14 03:45:23.567490 np0000000741 nova-compute[97948]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.40.100,3260] successful.
May 14 03:45:23.567490 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.596850 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.611605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.659050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.50.100,3260]
May 14 03:45:23.659050 np0000000741 nova-compute[97948]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-e12ff900-b1c8-42c3-beff-fc0d7919f513, portal: 192.168.50.100,3260] successful.
May 14 03:45:23.659050 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.679977 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:23.680841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:23.680841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== disconnect_volume: return (359ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:23.682209 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:45:23.783849 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:23.786285 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:23.794747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:23.858231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:23.858491 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance network_info: |[{"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:45:23.907123 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:23.939758 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:24.246221 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:24.675964 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:24.689124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:24.713440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:24.775496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:24.775763 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:24.787283 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:24.788189 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fecc:f561'] 
May 14 03:45:24.788365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:24.788604 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:24.790244 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:24.790244 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Updating existing volume attachment record: 7984f840-1fa4-4e7f-a08c-82e837d981d5 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:45:25.014124 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:25.014124 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:25.014124 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attaching volume 68afeadc-26f9-4d0e-a964-e15575723cb9 to /dev/vdb
May 14 03:45:25.060448 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:25.072225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:25.095511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:25.150883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:25.151681 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:25.161203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:25.163116 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fecc:f561'] 
May 14 03:45:25.163503 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:25.163809 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:25.164451 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:25.164818 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating existing volume attachment record: ee6cc772-3d9c-4cfc-b5f3-4b9e25909eaa {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:45:25.258929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-395f7fb8-508a-4c61-8b6d-61d5716c8ead tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.094s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:25.757912 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:25.759591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:25.759591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:25.760166 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:25.760539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:25.778920 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:25.778920 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:25.778920 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:25.779884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:25.782369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:25.782369 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:25.786057 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:25.786057 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:25.799206 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:25.799206 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:25.810945 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:25.810945 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:25.819245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:25.835560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.847689 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.847986 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:25.848371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:25.848447 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:25.849443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('10', '0', '0', 0) found on session 143 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:25.849609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:25.870663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 143 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:25.871327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:25.874683 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.093s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('11', '0', '0', 0) found on session 144 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:25.874683 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:25.891940 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 144 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:25.892601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:26.783695 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:26.787290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:26.938083 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:45:26.940383 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:45:26.940383 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Creating image(s)
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Ensure instance console log exists: /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:26.943025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Start _get_guest_xml network_info=[{"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9aa4f958-059f-4c2d-ae2d-9eafdeded1d0', 'attached_at': '', 'detached_at': '', 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'serial': '7ccb7a83-3060-4077-8c00-020a091b0ce2'}, 'boot_index': 0, 'attachment_id': '7984f840-1fa4-4e7f-a08c-82e837d981d5', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:45:26.946504 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:26.948252 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-917675860', uuid='9aa4f958-059f-4c2d-ae2d-9eafdeded1d0'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730326.9476612) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:45:26.954289 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:45:26.954693 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:45:26.956578 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:45:26.956578 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:45:26.957285 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:45:26.957596 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:45:26.957790 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:45:26.957913 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:45:26.958070 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:45:26.958219 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:45:26.958324 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:45:26.958521 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:45:26.958764 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:45:26.958920 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:45:26.959098 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:45:26.959364 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:45:26.975225 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:26.975894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:26.975894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:27.285921 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:27.807656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 33000000064d1fb5e for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:27.808015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:27.808174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (2049ms) {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:27.808312 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:27.809341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.834s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:27.809724 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:27.815813 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:27.822914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:27.826935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:27.827376 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:27.827608 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:27.827910 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:27.828067 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:27.839095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:27.839095 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:27.846698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:27.846698 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:27.853435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2] added
May 14 03:45:27.853435 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:27.853435 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:27.853435 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:27.853435 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:27.853435 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:27.853435 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:27.853819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:27.853869 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:27.854065 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:27.859799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2] added
May 14 03:45:27.859799 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:27.859799 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:27.859799 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:27.859799 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:27.859799 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:27.859799 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:27.860077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:27.860243 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:27.860416 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:28.285896 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:28.286485 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:28.319984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attempting to attach volume 68afeadc-26f9-4d0e-a964-e15575723cb9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:45:28.321935 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:28.321935 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:45:28.581887 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:28.582089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:28.794965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:28.794965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:28.794965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:28.794965 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:45:28.796817 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:28.854615 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:28.860908 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:28.871336 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:28.871336 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:28.879649 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:28.879649 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.887354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.898056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.917577 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.928538 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:28.928781 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:28.940877 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:28.967632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.40.100,3260]
May 14 03:45:28.967632 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.40.100,3260] successful.
May 14 03:45:28.967632 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.976208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.50.100,3260]
May 14 03:45:28.976208 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.50.100,3260] successful.
May 14 03:45:28.976208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.984991 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:28.993847 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.010106 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:29.010729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:29.010729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:29.012468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('9', '-', '-', 0) found on session 145 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:29.012915 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.021127 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:29.021779 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:29.021779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:29.022219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:29.023232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('12', '-', '-', 0) found on session 146 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:29.023425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:29.035377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:29.035600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:29.046549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 146 and hctl ['12', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:29.086754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:45:29.651550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:29.651727 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:29.656429 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:29.657296 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Claim successful on node np0000000741
May 14 03:45:29.832297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:29.935811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:29.936416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.028023 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:30.028253 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:30.028401 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:30.028667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:cc:f5:61, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:30.033401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.033986 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:30.037535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:30.037705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:30.039809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.063817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 146 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:30.068102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:30.159660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.159660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.274246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.274589 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:30.278751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:30.280280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.378236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.382659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.495419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.500231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.619511 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.620103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.725012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.729832 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:30.731039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:30.782705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:30.783182 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=11880MB free_disk=72.85690689086914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:45:30.783402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:30.853211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 3300000007ba65881 for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:30.853880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:30.854100 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3878ms) {'type': 'block', 'scsi_wwn': '3300000007ba65881', 'path': '/dev/dm-2', 'multipath_id': '3300000007ba65881'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:30.854317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ba65881', 'path': '/dev/dm-2', 'multipath_id': '3300000007ba65881'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:31.108819 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:31.109270 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:31.165518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:31.165749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:31.363189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-917675860',display_name='tempest-TestVolumeBootPattern-server-917675860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-917675860',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kaxbt02e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:21Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=9aa4f958-059f-4c2d-ae2d-9eafdeded1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:45:31.363189 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:31.364119 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:31.365175 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:31.585532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b4180308-a77a-40f8-860c-8c84e43f8bbf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.572s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:31.611876 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:31.668584 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Detaching volume f22f1200-9c5e-49ed-a36f-c9651e0e2f0a
May 14 03:45:31.711799 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Attempting to driver detach volume f22f1200-9c5e-49ed-a36f-c9651e0e2f0a from mountpoint /dev/vdc
May 14 03:45:31.715813 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found disk vdc by alias ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:45:31.716928 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Found disk vdc by alias ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:45:31.717075 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Attempting to detach device vdc from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:45:31.717346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <alias name="ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a"/>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <serial>f22f1200-9c5e-49ed-a36f-c9651e0e2f0a</serial>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:31.717346 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:45:31.722083 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully detached device vdc from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the persistent domain config.
May 14 03:45:31.722241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] (1/8): Attempting to detach device vdc with device alias ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:45:31.722526 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <alias name="ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a"/>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <serial>f22f1200-9c5e-49ed-a36f-c9651e0e2f0a</serial>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]: </disk>
May 14 03:45:31.722526 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:45:31.868548 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] End _get_guest_xml xml=<domain type="qemu">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <uuid>9aa4f958-059f-4c2d-ae2d-9eafdeded1d0</uuid>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <name>instance-00000038</name>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-917675860</nova:name>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:45:26</nova:creationTime>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         <nova:port uuid="a766843f-4d54-450e-a6c8-9f3fa906c70d">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <system>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="serial">9aa4f958-059f-4c2d-ae2d-9eafdeded1d0</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="uuid">9aa4f958-059f-4c2d-ae2d-9eafdeded1d0</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </system>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <os>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </os>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <features>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </features>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   <devices>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/disk.config"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <alias name="ua-7ccb7a83-3060-4077-8c00-020a091b0ce2"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-2"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <serial>7ccb7a83-3060-4077-8c00-020a091b0ce2</serial>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:d0:e0:e5"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <target dev="tapa766843f-4d"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </interface>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/console.log" append="off"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </serial>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <video>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </video>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </rng>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:   </devices>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]: </domain>
May 14 03:45:31.868548 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Preparing to wait for external event network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-917675860',display_name='tempest-TestVolumeBootPattern-server-917675860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-917675860',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kaxbt02e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:21Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=9aa4f958-059f-4c2d-ae2d-9eafdeded1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:31.870392 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:31.870632 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:45:31.871370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:31.871370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:31.871541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:45:31.872393 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:31.872568 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d3fdbb6-5b9d-5e1f-9041-d5882e81bbf0', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:31.875697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:31.883879 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:31.884171 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766843f-4d, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:31.884562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa766843f-4d, col_values=(('qos', UUID('01a13195-50fb-4624-8dd7-d0a914824a2d')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:31.884794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa766843f-4d, col_values=(('external_ids', {'iface-id': 'a766843f-4d54-450e-a6c8-9f3fa906c70d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:e0:e5', 'vm-uuid': '9aa4f958-059f-4c2d-ae2d-9eafdeded1d0'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:31.887935 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:31.892651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:31.893731 np0000000741 nova-compute[97948]: INFO os_vif [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d')
May 14 03:45:32.120470 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.469s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:32.121031 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:45:32.126282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.338s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:32.421723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730332.4213002, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:45:32.422726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a for instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:45:32.424810 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully detached device vdc from instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 from the live domain config.
May 14 03:45:32.425804 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:45:32.426159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:32.426321 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:32.426782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:32.427258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:45:32.427419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:32.467229 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:32.467749 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:32.467749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '146')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:45:32.468148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '141')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:32.469073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a', '140')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:32.470198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c4900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:45:32.470422 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:45:32.470713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Flush multipath device 330000000ed0081d6 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:45:32.501548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:32.551324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:32.612297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:45:32.612501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:45:32.613945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:45:32.626112 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:45:32.626340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:45:32.635051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:45:32.635869 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:45:32.635869 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:32.636137 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:32.643481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.682965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.40.100,3260]
May 14 03:45:32.682965 np0000000741 nova-compute[97948]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.40.100,3260] successful.
May 14 03:45:32.682965 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.705824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.718600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.729446 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51edcd1c632e43b5bdb146cbebe907af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b797253645468a8756aece06837896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:45:32.755008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.50.100,3260]
May 14 03:45:32.755008 np0000000741 nova-compute[97948]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-f22f1200-9c5e-49ed-a36f-c9651e0e2f0a, portal: 192.168.50.100,3260] successful.
May 14 03:45:32.755008 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.775740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:32.776005 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:32.776137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== disconnect_volume: return (349ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:32.776265 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:45:32.953566 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Stashing vm_state: active {{(pid=97948) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 03:45:33.144717 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:45:33.148297 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating resource usage from migration 9f54ed9c-3b75-42ec-b113-d37694af14ce
May 14 03:45:33.204356 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.204531 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.204656 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.204793 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.204903 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 608384f9-6f6b-428e-a519-f1631dc5deb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.205124 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.205124 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 826d2019-5737-4c3a-bd55-841fd6c6fb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.205219 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Migration 9f54ed9c-3b75-42ec-b113-d37694af14ce is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 03:45:33.205335 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a2050a6c-1c7b-4454-8a7e-14960f06b79b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:45:33.205565 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:45:33.205726 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:45:30 up 37 min,  2 users,  load average: 6.62, 6.75, 4.73\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '5', 'io_workload': '3', 'num_proj_13ed7a6b1bbd4c5c9d85a5d211329ed1': '1', 'num_task_resize_prep': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1', 'num_proj_60b797253645468a8756aece06837896': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:45:33.235293 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Successfully created port: 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:45:33.326219 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'flavor' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:33.412323 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:33.412514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:33.412752 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:d0:e0:e5, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:33.413149 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Using config drive
May 14 03:45:33.524594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:33.651066 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:45:33.713964 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:33.714100 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:33.764284 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Successfully updated port: 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:45:33.797033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:33.826478 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:33.826626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing instance network info cache due to event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:33.826828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:33.826912 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:33.827035 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:33.918495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:34.056988 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Creating config drive at /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/disk.config
May 14 03:45:34.060397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm57nf3yr {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:34.131492 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm57nf3yr" returned: 0 in 0.071s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:34.159012 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Booting with volume b0f9a6fa-6439-4dea-9415-41efaea6c9c1 at /dev/vda
May 14 03:45:34.208657 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:34.217917 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:34.227709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:34.252240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:34.271210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:34.305219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:34.305755 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:34.319488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:34.321833 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fedb:539', 'fe80::a4:11ff:fe30:7f5d', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fecc:f561'] 
May 14 03:45:34.321833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:34.321833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:34.321833 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:34.321833 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating existing volume attachment record: d5aa8db8-0579-4232-bfa5-073c23f50364 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:45:34.329181 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:34.332247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-14e3bd40-8365-42d5-ad80-f3675e5b5f7e tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.166s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:34.423819 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:34.620656 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:34.642503 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:34.655615 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:34.730016 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:45:34.730503 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.609s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:34.730796 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.206s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:34.731105 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:34.731271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97948) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 03:45:34.755340 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:34.872897 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b18091ed-f606-419b-a811-867bb5938a9c req-5abf54cb-dcb5-427e-9b07-0be6daafd89b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:34.873346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b18091ed-f606-419b-a811-867bb5938a9c req-5abf54cb-dcb5-427e-9b07-0be6daafd89b service nova] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:34.873556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b18091ed-f606-419b-a811-867bb5938a9c req-5abf54cb-dcb5-427e-9b07-0be6daafd89b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:34.873722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b18091ed-f606-419b-a811-867bb5938a9c req-5abf54cb-dcb5-427e-9b07-0be6daafd89b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:34.873909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b18091ed-f606-419b-a811-867bb5938a9c req-5abf54cb-dcb5-427e-9b07-0be6daafd89b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Processing event network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:45:35.010410 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:35.041625 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:35.145215 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-43d56790-8e46-4e8b-a4d4-9788b052a1a4 req-db886a87-6583-4276-a40d-bfdf7ba69b42 service nova] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:35.145460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:35.145721 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:35.233580 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:35.242272 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:35.242503 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Claim successful on node np0000000741
May 14 03:45:35.663963 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730335.6632469, 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:35.664391 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] VM Started (Lifecycle Event)
May 14 03:45:35.665337 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:45:35.674352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:45:35.676176 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance spawned successfully.
May 14 03:45:35.676746 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:45:35.726278 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:35.726826 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:35.727087 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:45:35.729018 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:45:35.730032 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.06 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:45:35.747772 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:35.750339 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating resource usage from migration 9f54ed9c-3b75-42ec-b113-d37694af14ce
May 14 03:45:35.913858 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-changed-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:35.914067 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing instance network info cache due to event network-changed-193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:35.914269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:35.914484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:35.914649 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing network info cache for port 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:36.040697 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:36.169239 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:36.175559 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:36.189158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.189158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.189158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.189158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.189158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.189337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:36.267501 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:36.417802 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:36.462658 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:45:36.463325 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:45:36.463567 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Creating image(s)
May 14 03:45:36.463882 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:45:36.464057 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Ensure instance console log exists: /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:45:36.464658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:36.464658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:36.464658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:36.485186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:36.485504 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:36.679094 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:45:36.679407 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730336.6791825, 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:36.679562 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] VM Paused (Lifecycle Event)
May 14 03:45:36.704466 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Took 9.77 seconds to spawn the instance on the hypervisor.
May 14 03:45:36.704631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:36.771817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:36.772117 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance network_info: |[{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:45:36.773141 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Start _get_guest_xml network_info=[{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '826d2019-5737-4c3a-bd55-841fd6c6fb86', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'serial': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1'}, 'boot_index': 0, 'attachment_id': 'd5aa8db8-0579-4232-bfa5-073c23f50364', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:45:36.782962 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:36.786383 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1512050129', uuid='826d2019-5737-4c3a-bd55-841fd6c6fb86'), owner=OwnerMeta(userid='51edcd1c632e43b5bdb146cbebe907af', username='tempest-TestVolumeBackupRestore-1546488814-project-member', projectid='60b797253645468a8756aece06837896', projectname='tempest-TestVolumeBackupRestore-1546488814'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730336.7850435) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:45:36.788259 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:45:36.788734 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:45:36.790546 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:45:36.790788 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:45:36.792120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:45:36.792432 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:45:36.792585 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:45:36.792779 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:45:36.792924 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:45:36.793067 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:45:36.793159 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:45:36.793425 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:45:36.793561 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:45:36.793681 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:45:36.793815 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:45:36.793951 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:45:36.812897 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:36.815334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:36.815334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:36.815334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:36.815334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:36.830174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:36.831163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:36.832415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:36.832415 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:36.832542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:36.833066 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:36.853182 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:36.853182 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:36.854718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:45:36.854718 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1] added
May 14 03:45:36.870405 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:36.870405 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:36.870405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:36.871193 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:36.871193 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:36.876996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1] added
May 14 03:45:36.876996 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:45:36.876996 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:36.876996 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:36.876996 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:45:36.876996 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:45:36.876996 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:36.877292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:45:36.877417 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0446(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:45:36.877572 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:45:36.881839 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:36.887273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:36.962865 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:36.965102 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:36.965419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:36.965486 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:36.965652 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] No waiting events found dispatching network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:36.965794 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received unexpected event network-vif-plugged-a766843f-4d54-450e-a6c8-9f3fa906c70d for instance with vm_state active and task_state None.
May 14 03:45:36.965907 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-changed-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:36.966020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing instance network info cache due to event network-changed-193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:36.966220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Acquiring lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:36.989226 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:37.070771 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updated VIF entry in instance network info cache for port 193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:37.071164 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:37.117598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:37.117799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:37.118078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:37.118145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:37.118245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:37.121018 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Terminating instance
May 14 03:45:37.185972 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:37.189296 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730337.1882815, 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:37.189296 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] VM Resumed (Lifecycle Event)
May 14 03:45:37.219486 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Took 20.72 seconds to build instance.
May 14 03:45:37.498272 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.767s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:37.498781 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Migrating
May 14 03:45:37.498781 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:45:37.573743 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2188c3a0-b27c-4c43-9114-901014dd44df req-cfbca158-b4dc-47a2-8fde-a5537b1cf1cc service nova] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:37.574411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Acquired lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:37.574565 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Refreshing network info cache for port 193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:37.626755 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:45:37.666522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:37.694164 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:37.698835 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:37.700673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:37.702157 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:37.722073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-45f1ea60-8511-496a-8eb7-86a4a642b5b0 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.228s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:37.740594 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:37.871652 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:37.879308 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:37.893505 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:37.893505 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:37.902460 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:37.902460 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:37.911745 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:37.921381 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.934965 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.935399 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:37.956518 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:37.998108 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Instance destroyed successfully.
May 14 03:45:37.998759 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lazy-loading 'resources' on Instance uuid 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:38.001375 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.40.100,3260]
May 14 03:45:38.001375 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.40.100,3260] successful.
May 14 03:45:38.001375 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:38.010133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.50.100,3260]
May 14 03:45:38.010133 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.50.100,3260] successful.
May 14 03:45:38.010133 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:38.020234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:38.020234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:38.020234 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:38.024816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:38.026249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.050010 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.050434 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:38.050789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:38.050865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:38.052529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] HCTL ('7', '-', '-', 0) found on session 147 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:38.052702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.062101 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:38.062493 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:38.062793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:38.062867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:38.064680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] HCTL ('8', '-', '-', 0) found on session 148 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:38.064680 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:38.077231 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:38.101532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:38.101532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:38.116364 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Searching for a device in session 148 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:38.116597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:38.213611 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999632622999798 future=<Future at 0x79d0b002f890 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:38.218928 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.994581418000053 future=<Future at 0x79d0b002f890 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:38.218928 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.994402828000148 future=<Future at 0x79d0b002f890 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:38.486474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:38.486474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:38.486696 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:38.486768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:38.486934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:38.490240 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Terminating instance
May 14 03:45:38.503024 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:38.505872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1268328156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testinstanceswithcindervolumes-server-1268328156',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWmMXlc0Sgi5/C6KQRIK02ZyZibaHqFjRdrBog36rpqe+1oSqigVaId7lKyN9BG1ZH2KBKrc+n3Tv09KSnUACplRwPkMQkKIu/zqi0z7JWjbQ7pTfAtR5FLGy4SevRniQ==',key_name='tempest-TestInstancesWithCinderVolumes-25559803',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:44:14Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ed7a6b1bbd4c5c9d85a5d211329ed1',ramdisk_id='',reservation_id='r-2x0lr4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-2040779555',owner_user_name='tempest-TestInstancesWithCinderVolumes-2040779555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:44:14Z,user_data=None,user_id='31460db6e0e54652a720e19805f2039a',uuid=1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:45:38.506063 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converting VIF {"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:38.507042 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:38.507730 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:45:38.509765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:38.513110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap193c146f-31, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:38.515700 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:38.516774 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:38.517651 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:38.517864 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b98506e6-3cc0-45cf-a10f-97d6451aafe2) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:38.519874 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:38.521496 np0000000741 nova-compute[97948]: INFO os_vif [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:05:39,bridge_name='br-int',has_traffic_filtering=True,id=193c146f-3184-4c67-b207-5bcf01065988,network=Network(99723102-9f5f-4730-8c16-50ed668f69c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193c146f-31')
May 14 03:45:38.522178 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:38.524944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:45:38.524944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:38.525064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:38.705465 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updated VIF entry in instance network info cache for port 193c146f-3184-4c67-b207-5bcf01065988. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:38.705465 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [{"id": "193c146f-3184-4c67-b207-5bcf01065988", "address": "fa:16:3e:db:05:39", "network": {"id": "99723102-9f5f-4730-8c16-50ed668f69c5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1592494984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13ed7a6b1bbd4c5c9d85a5d211329ed1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap193c146f-31", "ovs_interfaceid": "193c146f-3184-4c67-b207-5bcf01065988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:38.801284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:38.833622 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:38.894757 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:38.993121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:45:39.016805 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.041281 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:39.044264 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.061530 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:39.062097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:39.062274 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:39.062436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:39.062587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] No waiting events found dispatching network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:39.062743 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:39.063163 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:39.063315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Acquiring lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:39.063476 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:39.063605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:39.063766 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] No waiting events found dispatching network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:39.063876 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-52965023-780c-436f-893c-665ad9eb57cf req-51d055a4-4e47-48cc-81e3-fed1a08f8e13 service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-unplugged-193c146f-3184-4c67-b207-5bcf01065988 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:39.075490 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.206826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b00553f0-9244-40c4-9e93-b560f05469d9 req-1445fbab-798c-4fab-96a7-5db9b667a040 service nova] Releasing lock "refresh_cache-1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:39.317623 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999645555999905 future=<Future at 0x79d0b009c2c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:39.319441 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Instance destroyed successfully.
May 14 03:45:39.320019 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:39.546208 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:39.823255 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-917675860',display_name='tempest-TestVolumeBootPattern-server-917675860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-917675860',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:45:36Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kaxbt02e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:45:37Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=9aa4f958-059f-4c2d-ae2d-9eafdeded1d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:45:39.823443 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "address": "fa:16:3e:d0:e0:e5", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766843f-4d", "ovs_interfaceid": "a766843f-4d54-450e-a6c8-9f3fa906c70d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:39.823887 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:39.824064 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:45:39.824741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.824909 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766843f-4d, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:39.825757 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.827092 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:39.827092 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.827684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.827796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01a13195-50fb-4624-8dd7-d0a914824a2d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:39.829174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:39.829174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:39.830751 np0000000741 nova-compute[97948]: INFO os_vif [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e0:e5,bridge_name='br-int',has_traffic_filtering=True,id=a766843f-4d54-450e-a6c8-9f3fa906c70d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766843f-4d')
May 14 03:45:39.832102 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:45:39.832804 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:39.832804 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:39.849061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Found WWN 330000000479ff130 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:39.849377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:39.849551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000479ff130', 'path': '/dev/dm-0', 'multipath_id': '330000000479ff130'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:39.849913 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000479ff130', 'path': '/dev/dm-0', 'multipath_id': '330000000479ff130'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:39.850282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.325s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:39.850833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a236d59-2b32-4c53-ac02-c98ac419fb6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:45:39.850958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:39.880820 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:39.881393 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '148')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:45:39.881393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '128')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:39.883034 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d', '129')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:39.883699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c13a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'): ({'sdk'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:45:39.883976 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Removing multipathed devices sdj, sdk {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:45:39.884199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Flush multipath device 330000000276e40d0 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:45:39.949290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:40.001459 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:40.060086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:45:40.060561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:45:40.061921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:45:40.076491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:45:40.076762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:45:40.092250 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.152480 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.154058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.40.100,3260]
May 14 03:45:40.154058 np0000000741 nova-compute[97948]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.40.100,3260] successful.
May 14 03:45:40.154058 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.177433 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.194874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.239323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.50.100,3260]
May 14 03:45:40.239323 np0000000741 nova-compute[97948]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-2a236d59-2b32-4c53-ac02-c98ac419fb6d, portal: 192.168.50.100,3260] successful.
May 14 03:45:40.239323 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.258514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.259708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:40.259708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] <== disconnect_volume: return (1734ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:40.259708 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:45:40.259708 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Deleting instance files /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9_del
May 14 03:45:40.260288 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Deletion of /opt/stack/data/nova/instances/1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9_del complete
May 14 03:45:40.262072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.427s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:40.262153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ccb7a83-3060-4077-8c00-020a091b0ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:45:40.262249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:40.298886 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:40.299198 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:40.299198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '148')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:45:40.299492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '145')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:40.300354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2', '146')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:45:40.301269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c0cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:45:40.301444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdd, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:45:40.301676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 3300000007ba65881 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:45:40.358374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1512050129',display_name='tempest-TestVolumeBackupRestore-server-1512050129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebackuprestore-server-1512050129',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8aNgisB1Lv/2zIMDjQkswkEcOQL7QJ5uX+PiOPEq9b3BVbrlPLpDQ4+EPAY2M83Y+IK2wJ8+04554/RTb9koKUIrDMg6G8EE0WTowcwohe67vfICY9MuKPuNiQuKVCxQ==',key_name='tempest-TestVolumeBackupRestore-1069183106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b797253645468a8756aece06837896',ramdisk_id='',reservation_id='r-mv6qv0x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1546488814',owner_user_name='tempest-TestVolumeBackupRestore-1546488814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:34Z,user_data=None,user_id='51edcd1c632e43b5bdb146cbebe907af',uuid=826d2019-5737-4c3a-bd55-841fd6c6fb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:45:40.358374 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converting VIF {"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:40.358810 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:40.359653 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lazy-loading 'pci_devices' on Instance uuid 826d2019-5737-4c3a-bd55-841fd6c6fb86 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:40.363030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:40.412416 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:45:40.461034 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:45:40.462219 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:45:40.462505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:45:40.476058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:45:40.476274 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:45:40.488729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.533814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.40.100,3260]
May 14 03:45:40.533814 np0000000741 nova-compute[97948]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.40.100,3260] successful.
May 14 03:45:40.533814 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.559079 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.577457 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.622014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.50.100,3260]
May 14 03:45:40.622014 np0000000741 nova-compute[97948]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-7ccb7a83-3060-4077-8c00-020a091b0ce2, portal: 192.168.50.100,3260] successful.
May 14 03:45:40.622014 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.639494 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:40.639743 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:40.639880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (807ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:40.641536 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:45:40.641857 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Deleting instance files /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0_del
May 14 03:45:40.642360 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Deletion of /opt/stack/data/nova/instances/9aa4f958-059f-4c2d-ae2d-9eafdeded1d0_del complete
May 14 03:45:40.768206 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Took 3.14 seconds to destroy the instance on the hypervisor.
May 14 03:45:40.769162 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:45:40.769162 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:45:40.769828 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:45:40.771254 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:40.866032 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] End _get_guest_xml xml=<domain type="qemu">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <uuid>826d2019-5737-4c3a-bd55-841fd6c6fb86</uuid>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <name>instance-00000039</name>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBackupRestore-server-1512050129</nova:name>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:45:36</nova:creationTime>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:user uuid="51edcd1c632e43b5bdb146cbebe907af">tempest-TestVolumeBackupRestore-1546488814-project-member</nova:user>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:project uuid="60b797253645468a8756aece06837896">tempest-TestVolumeBackupRestore-1546488814</nova:project>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         <nova:port uuid="330c93e3-db19-45ff-8ea9-4bcfb3a407be">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <system>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="serial">826d2019-5737-4c3a-bd55-841fd6c6fb86</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="uuid">826d2019-5737-4c3a-bd55-841fd6c6fb86</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </system>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <os>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </os>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <features>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </features>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   <devices>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/disk.config"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <alias name="ua-b0f9a6fa-6439-4dea-9415-41efaea6c9c1"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <serial>b0f9a6fa-6439-4dea-9415-41efaea6c9c1</serial>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:13:bf:2b"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <target dev="tap330c93e3-db"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </interface>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/console.log" append="off"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </serial>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <video>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </video>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </rng>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:   </devices>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]: </domain>
May 14 03:45:40.866032 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Preparing to wait for external event network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1512050129',display_name='tempest-TestVolumeBackupRestore-server-1512050129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebackuprestore-server-1512050129',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8aNgisB1Lv/2zIMDjQkswkEcOQL7QJ5uX+PiOPEq9b3BVbrlPLpDQ4+EPAY2M83Y+IK2wJ8+04554/RTb9koKUIrDMg6G8EE0WTowcwohe67vfICY9MuKPuNiQuKVCxQ==',key_name='tempest-TestVolumeBackupRestore-1069183106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b797253645468a8756aece06837896',ramdisk_id='',reservation_id='r-mv6qv0x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1546488814',owner_user_name='tempest-TestVolumeBackupRestore-1546488814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:34Z,user_data=None,user_id='51edcd1c632e43b5bdb146cbebe907af',uuid=826d2019-5737-4c3a-bd55-841fd6c6fb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converting VIF {"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:40.869226 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:45:40.872625 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:40.874068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.877034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:40.877034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:45:40.877034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.877034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71c8fa37-93c8-5345-905b-904ecdd8ce1d', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:40.880838 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.881983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:40.885949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.886186 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap330c93e3-db, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:40.886977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap330c93e3-db, col_values=(('qos', UUID('5d204fc4-5930-439a-bb93-89da289455cd')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:40.887504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap330c93e3-db, col_values=(('external_ids', {'iface-id': '330c93e3-db19-45ff-8ea9-4bcfb3a407be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:bf:2b', 'vm-uuid': '826d2019-5737-4c3a-bd55-841fd6c6fb86'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:40.888732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.890837 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:40.898871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:40.899956 np0000000741 nova-compute[97948]: INFO os_vif [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db')
May 14 03:45:41.062147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Starting migrate_disk_and_power_off {{(pid=97948) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 03:45:41.100342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.121665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.158590 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Took 2.17 seconds to destroy the instance on the hypervisor.
May 14 03:45:41.159712 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:45:41.160213 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:45:41.160213 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:45:41.160339 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:41.179414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:41.179872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:41.179941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:41.180159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:41.180219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] No waiting events found dispatching network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:41.180355 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:41.180510 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:41.180603 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Acquiring lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:41.180770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:41.180880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:41.180998 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] No waiting events found dispatching network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:41.181120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe3269c0-2d3f-42f6-8838-ceea68358065 req-b47f8a74-adfe-4cc2-8b3f-f4736ea7242b service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-unplugged-a766843f-4d54-450e-a6c8-9f3fa906c70d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:45:41.273536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.285092 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.298431 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6b145102-b91a-448a-a000-3d4113fdf2b3 req-e7a932b5-9623-430a-aa79-c4d0ccfad31d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Received event network-vif-deleted-193c146f-3184-4c67-b207-5bcf01065988 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:41.298591 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-6b145102-b91a-448a-a000-3d4113fdf2b3 req-e7a932b5-9623-430a-aa79-c4d0ccfad31d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Neutron deleted interface 193c146f-3184-4c67-b207-5bcf01065988; detaching it from the instance and deleting it from the info cache
May 14 03:45:41.298738 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6b145102-b91a-448a-a000-3d4113fdf2b3 req-e7a932b5-9623-430a-aa79-c4d0ccfad31d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:41.382071 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:41.391894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.403745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.423804 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99963326299985 future=<Future at 0x79d0907308c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:41.429283 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance destroyed successfully.
May 14 03:45:41.430295 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:44:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:45:41.430503 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:41.430971 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:41.431153 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:45:41.432483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.433206 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b5f3126-9e, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:41.436391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.436391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:41.441187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.442438 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.442664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=726a44a2-e88a-4820-a4d7-2c30a2173927) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:41.444709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:41.452321 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:41.455659 np0000000741 nova-compute[97948]: INFO os_vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e')
May 14 03:45:41.723189 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:41.802324 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6b145102-b91a-448a-a000-3d4113fdf2b3 req-e7a932b5-9623-430a-aa79-c4d0ccfad31d service nova] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Detach interface failed, port_id=193c146f-3184-4c67-b207-5bcf01065988, reason: Instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:45:42.018852 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Detected multiple connections on this host for volume: 68afeadc-26f9-4d0e-a964-e15575723cb9, skipping target disconnect.
May 14 03:45:42.024467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:42.087022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:42.141415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:42.142509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:42.227246 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Took 1.46 seconds to deallocate network for instance.
May 14 03:45:42.253236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:42.254049 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:45:42.254679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:42.372028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:42.372432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk.config /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:42.425465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk.config /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:42.428542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk.info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:42.448823 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:42.449010 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:45:42.449182 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] No VIF found with MAC fa:16:3e:13:bf:2b, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:45:42.450341 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Using config drive
May 14 03:45:42.480066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_resize/disk.info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:42.782634 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:42.784329 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:45:42.959405 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:43.163141 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Creating config drive at /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/disk.config
May 14 03:45:43.167769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjabvuhdu {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:43.243819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjabvuhdu" returned: 0 in 0.076s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:43.287603 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Took 2.13 seconds to deallocate network for instance.
May 14 03:45:43.294388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:43.294804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:43.389815 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5e4f02c3-dd29-4110-b3a4-3eb8d0bf3334 req-cc5ca6a7-7e37-4daf-af75-e461ba30c33f service nova] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Received event network-vif-deleted-a766843f-4d54-450e-a6c8-9f3fa906c70d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:43.419542 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:43.419542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:43.419542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:43.420398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:43.420781 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:43.420924 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received unexpected event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with vm_state active and task_state resize_migrating.
May 14 03:45:43.421049 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:43.421196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:43.421347 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:43.421465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:43.421583 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:43.421756 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-97e8ea4c-6c45-41f3-a077-6a00f4486cad req-83319fde-847c-4d63-bcb5-8d44df544609 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received unexpected event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with vm_state active and task_state resize_migrating.
May 14 03:45:43.559220 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Refreshing inventories for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 03:45:43.618161 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Updating ProviderTree inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 03:45:43.619248 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:43.619688 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:45:43.621374 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:43.698008 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Refreshing aggregate associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, aggregates: None {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 03:45:43.706606 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:43.737184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:43.738211 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:43.753899 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Refreshing trait associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_MIPSEL,COMPUTE_NODE,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_AARCH64,COMPUTE_ARCH_RISCV64 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 03:45:43.758035 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Port 4b5f3126-9e98-4485-b87a-b6a8cee76119 binding to destination host np0000000741 is already ACTIVE {{(pid=97948) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 03:45:43.808674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:43.837428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:43.860328 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Took 0.57 seconds to detach 1 volumes for instance.
May 14 03:45:43.864138 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Deleting volume: 7ccb7a83-3060-4077-8c00-020a091b0ce2 {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:45:44.063924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:44.067824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:44.099466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:44.296156 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:44.296432 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:44.397549 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:44.428083 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:44.638623 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730344.638253, 826d2019-5737-4c3a-bd55-841fd6c6fb86 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:44.638839 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] VM Started (Lifecycle Event)
May 14 03:45:44.768760 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:45:44.780913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:44.781608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:44.781827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:44.799424 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:45.000436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:45.141688 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:45.145002 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730345.1446857, 826d2019-5737-4c3a-bd55-841fd6c6fb86 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:45.145159 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] VM Paused (Lifecycle Event)
May 14 03:45:45.307697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.013s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:45.309202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.880s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:45.365681 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Deleted allocations for instance 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9
May 14 03:45:45.647933 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:45.652810 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:45.793446 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:45.804625 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:45.804625 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:46.051295 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:46.051664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:46.051664 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:46.154907 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:45:46.306957 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:46.375016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-afb472e6-6ff2-4737-9885-c75453bef3c5 tempest-TestInstancesWithCinderVolumes-2040779555 tempest-TestInstancesWithCinderVolumes-2040779555-project-member] Lock "1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.257s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:46.445982 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:46.553306 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:46.774521 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:46.814785 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.507s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:46.889054 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0
May 14 03:45:46.935755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:47.018607 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:47.168071 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:47.670009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:47.896401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e8e1d78a-a7df-42c2-9d3b-cb2bd0dda5c6 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "9aa4f958-059f-4c2d-ae2d-9eafdeded1d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.410s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:48.177709 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:48.191846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:45:48.214091 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:48.268609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:45:48.269497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:45:48.280769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:45:48.281874 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe13:bf2b', 'fe80::705c:47ff:fead:8736'] 
May 14 03:45:48.282034 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:45:48.282193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:45:48.282481 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:48.634692 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-20f3b4ff-ddba-487e-b7c7-9ea267250738 req-1a8a07c4-a55d-4eef-aeb8-609960caf0a5 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:48.635412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-20f3b4ff-ddba-487e-b7c7-9ea267250738 req-1a8a07c4-a55d-4eef-aeb8-609960caf0a5 service nova] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:48.635691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-20f3b4ff-ddba-487e-b7c7-9ea267250738 req-1a8a07c4-a55d-4eef-aeb8-609960caf0a5 service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:48.635904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-20f3b4ff-ddba-487e-b7c7-9ea267250738 req-1a8a07c4-a55d-4eef-aeb8-609960caf0a5 service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:48.636091 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-20f3b4ff-ddba-487e-b7c7-9ea267250738 req-1a8a07c4-a55d-4eef-aeb8-609960caf0a5 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Processing event network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:45:48.636808 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:45:48.642164 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730348.6417422, 826d2019-5737-4c3a-bd55-841fd6c6fb86 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:48.643975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:45:48.644461 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] VM Resumed (Lifecycle Event)
May 14 03:45:48.649980 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance spawned successfully.
May 14 03:45:48.650793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:45:48.811611 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:49.148817 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:49.153094 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.164565 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:45:49.440936 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Starting finish_migration {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 03:45:49.442541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:45:49.442716 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Creating image(s)
May 14 03:45:49.443981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:49.551408 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:49.551408 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:45:49.551408 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:49.659630 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:45:49.670697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:49.671245 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:45:49.677788 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Took 13.22 seconds to spawn the instance on the hypervisor.
May 14 03:45:49.678058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:50.084463 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:50.175489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:45:50.175758 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Ensure instance console log exists: /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:45:50.176136 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:50.176465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:50.176996 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:50.180722 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start _get_guest_xml network_info=[{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a2050a6c-1c7b-4454-8a7e-14960f06b79b', 'attached_at': '2026-05-14T03:45:48.000000', 'detached_at': '', 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'multiattach': True, 'serial': '68afeadc-26f9-4d0e-a964-e15575723cb9'}, 'boot_index': None, 'attachment_id': 'e8710b1c-712a-42ba-929d-47fa0512c8ca', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:45:50.188139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:50.188339 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:50.194597 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Took 20.60 seconds to build instance.
May 14 03:45:50.197882 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:50.200230 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='a2050a6c-1c7b-4454-8a7e-14960f06b79b'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730350.1998641) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:45:50.203408 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:45:50.204763 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:45:50.211718 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:45:50.226853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:50.344549 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:50.345333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:50.345950 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:50.346924 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:50.348661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:45:50.348661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:45:50.348661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:50.350352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:50.351751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:45:50.366035 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:50.366782 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:45:50.368188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:50.368706 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:45:50.369330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:45:50.369657 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:50.383584 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:50.383584 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:45:50.395856 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:45:50.395856 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:50.399159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:50.409315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.419059 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.419301 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:50.419617 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:50.419748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:50.420315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('10', '0', '0', 0) found on session 143 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:50.420436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.429277 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:45:50.429656 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:45:50.429882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:50.429882 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:45:50.430530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('11', '0', '0', 0) found on session 144 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:45:50.430530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:45:50.437383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 143 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:50.437603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:50.442105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 144 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:45:50.442715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:45:50.690697 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:45:50.702660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.120s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:50.728451 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:50.728926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:50.732236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:50.732399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:50.732562 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] No waiting events found dispatching network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:45:50.732740 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3481ea3e-6a84-4ed4-b443-7cb32f0482f1 req-c68e0929-86d9-4c8e-bd42-62e34736ccb7 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received unexpected event network-vif-plugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be for instance with vm_state active and task_state None.
May 14 03:45:50.811050 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:51.260671 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:51.261451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:51.267556 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:51.267841 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Claim successful on node np0000000741
May 14 03:45:51.368519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:45:51.447575 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:51.466710 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:52.096861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:52.800569 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:52.800902 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:52.830349 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:52.831429 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing instance network info cache due to event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:52.831674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:52.832337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:52.832599 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:53.213761 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000451771999905759 future=<Future at 0x79d0b002f890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:53.215190 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Emitting event <LifecycleEvent: 1778730338.2131157, 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:53.215190 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:53.215190 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] VM Stopped (Lifecycle Event)
May 14 03:45:53.216178 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.101078746999974 future=<Future at 0x79d0b009c2c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:53.216319 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=1.100908082999922 future=<Future at 0x79d0b009c2c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:53.303696 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:53.336409 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:53.717927 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: 1d917d16-f5bb-44ff-8c91-f6f46d6ef8a9] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:53.753874 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:53.810773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.549s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:53.811545 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:53.812594 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:45:54.069615 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:54.220326 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updated VIF entry in instance network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:54.220553 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:54.319442 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:45:54.320547 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0031670190001023 future=<Future at 0x79d0b009c2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:54.320791 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730339.3171701, 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:54.321067 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:45:54.321337 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:54.321674 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] VM Stopped (Lifecycle Event)
May 14 03:45:54.322692 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:54.323148 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.100317957000243 future=<Future at 0x79d0907308c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:54.323274 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:54.327418 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.0960426530000404 future=<Future at 0x79d0907308c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:54.420771 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f875de7ee454dd4ad6918c6794941f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af4cde5a4934c1e8d619ec5b8c8adc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:45:54.723065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-df28c85d-cf5f-4133-8297-d15be06930b9 req-ae46aa77-e47f-4aa8-96ec-ffe37ca57c5f service nova] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:54.827695 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:45:54.830655 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a009f3f0-8133-4a6e-b983-2deefcbd226e tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 9aa4f958-059f-4c2d-ae2d-9eafdeded1d0] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:54.933521 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:54.936696 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing instance network info cache due to event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:54.937079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:54.937079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:54.937278 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:54.962616 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Successfully created port: e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:45:55.276143 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:55.276391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:55.331428 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:45:55.439758 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:55.580017 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Successfully updated port: e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:45:55.641332 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:55.641653 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing instance network info cache due to event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:55.641829 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:55.641927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:55.642067 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:55.778278 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:45:55.845244 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:55.845855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:55.851201 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:56.002204 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updated VIF entry in instance network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:56.002553 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:56.082500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:56.143896 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:56.246564 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:56.342977 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:45:56.344044 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:45:56.347545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:45:56.351070 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Creating image(s)
May 14 03:45:56.352876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:56.353068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:56.353576 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:56.353910 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "44dec103d8b45e46a812f9fa074e08154cf2edab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:56.354239 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "44dec103d8b45e46a812f9fa074e08154cf2edab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:56.368762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:56.368762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:56.375721 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:56.377763 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Claim successful on node np0000000741
May 14 03:45:56.424954 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0014495989998977166 future=<Future at 0x79d0907308c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:56.425426 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] Emitting event <LifecycleEvent: 1778730341.4233313, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:45:56.425650 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:45:56.425843 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Stopped (Lifecycle Event)
May 14 03:45:56.446392 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:56.449404 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:56.504683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:56.504871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:45:56.504998 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing instance network info cache due to event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:45:56.505175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:45:56.505275 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:56.505395 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:45:56.925549 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:56.928630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:45:56.932016 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:45:56.950340 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9da2d360-a5e6-4a01-9666-bf30830a7225 req-154fa653-64de-4aa8-84e8-e52595c491c3 service nova] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:56.951093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:45:56.951261 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:45:57.008248 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:57.103451 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.106950 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.107305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.204854 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.part --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.205254 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ff695fdc-7169-4a4a-a269-34745541257b was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:45:57.205986 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:45:57.206329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.part /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.379232 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.part /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.converted" returned: 0 in 0.170s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.383651 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.439546 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d86ac9d4-f62d-4fd6-b3ac-7cb695c81dd3 tempest-VolumesActionsTest-1771154880 tempest-VolumesActionsTest-1771154880-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:45:57.471604 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:57.494706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab.converted --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.495356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "44dec103d8b45e46a812f9fa074e08154cf2edab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.141s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:57.496274 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.499546 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.501028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.568812 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:45:57.613697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json" returned: 0 in 0.112s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.613697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "44dec103d8b45e46a812f9fa074e08154cf2edab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:57.614024 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "44dec103d8b45e46a812f9fa074e08154cf2edab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:57.614545 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.617980 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:45:57.618321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.712607 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updated VIF entry in instance network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:45:57.712607 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:57.732042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.732695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab,backing_fmt=raw /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.795583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab,backing_fmt=raw /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk 1073741824" returned: 0 in 0.063s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.796047 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "44dec103d8b45e46a812f9fa074e08154cf2edab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:57.796394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:57.900484 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:57.910980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:57.911387 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:45:57.911650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:45:58.020490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:45:58.020963 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Cannot resize image /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:45:58.021383 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:45:58.021677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Ensure instance console log exists: /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:45:58.022214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:58.022214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:58.022307 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:58.128230 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:45:58.217064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5add7b7d-2bf0-4fe7-bf17-fbf56a9d5b75 req-b7333d07-d3c7-460e-9f0a-66a32d2e2e92 service nova] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:58.251726 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.266653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:45:58.266898 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:45:58.416930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 33000000064d1fb5e for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:45:58.417397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.067s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:45:58.417620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (8068ms) {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:45:58.417785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:45:58.632964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:45:58.633323 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance network_info: |[{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:45:58.636941 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start _get_guest_xml network_info=[{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:45:47Z,direct_url=<?>,disk_format='qcow2',id=ff695fdc-7169-4a4a-a269-34745541257b,min_disk=0,min_ram=0,name='tempest-scenario-img--1949384892',owner='6af4cde5a4934c1e8d619ec5b8c8adc9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:45:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': 'ff695fdc-7169-4a4a-a269-34745541257b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:45:58.644048 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:45:58.646987 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ff695fdc-7169-4a4a-a269-34745541257b', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-733319753', uuid='6e392e3e-de9b-4cf1-801e-29301cb35483'), owner=OwnerMeta(userid='8f875de7ee454dd4ad6918c6794941f1', username='tempest-TestMinimumBasicScenario-1441934481-project-member', projectid='6af4cde5a4934c1e8d619ec5b8c8adc9', projectname='tempest-TestMinimumBasicScenario-1441934481'), image=ImageMeta(id='ff695fdc-7169-4a4a-a269-34745541257b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730358.646471) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:45:58.648754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:45:58.649147 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:45:58.650057 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:45:58.650246 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:45:58.651363 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:45:58.651762 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:45:47Z,direct_url=<?>,disk_format='qcow2',id=ff695fdc-7169-4a4a-a269-34745541257b,min_disk=0,min_ram=0,name='tempest-scenario-img--1949384892',owner='6af4cde5a4934c1e8d619ec5b8c8adc9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:45:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:45:58.651942 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:45:58.652061 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:45:58.652222 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:45:58.652517 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:45:58.652712 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:45:58.652914 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:45:58.653054 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:45:58.653377 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:45:58.653433 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:45:58.653552 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:45:58.668661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:55Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:45:58.668992 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:58.669570 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:58.670251 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:45:58.769966 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:45:58.812908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.923670 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:44:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:45:58.923834 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:58.924279 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:58.925899 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <uuid>a2050a6c-1c7b-4454-8a7e-14960f06b79b</uuid>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <name>instance-00000036</name>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <memory>262144</memory>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-0</nova:name>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:45:50</nova:creationTime>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.micro" id="84">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:memory>256</nova:memory>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         <nova:port uuid="4b5f3126-9e98-4485-b87a-b6a8cee76119">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <system>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="serial">a2050a6c-1c7b-4454-8a7e-14960f06b79b</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="uuid">a2050a6c-1c7b-4454-8a7e-14960f06b79b</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </system>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <os>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </os>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <features>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </features>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   <devices>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk.config"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <shareable/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:1c:30:f8"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <target dev="tap4b5f3126-9e"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </interface>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/console.log" append="off"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </serial>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <video>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </video>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </rng>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:   </devices>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]: </domain>
May 14 03:45:58.925899 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:44:51Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:1c:30:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:58.928856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:45:58.929223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.930346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '657c48e0-a667-56ee-bfc3-60be8f578b26', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:58.930346 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.930833 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:58.931269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.933281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.936664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b5f3126-9e, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:58.936664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b5f3126-9e, col_values=(('qos', UUID('ddbc268c-620f-4238-9408-3eeb71cc0a75')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:58.936664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b5f3126-9e, col_values=(('external_ids', {'iface-id': '4b5f3126-9e98-4485-b87a-b6a8cee76119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:30:f8', 'vm-uuid': 'a2050a6c-1c7b-4454-8a7e-14960f06b79b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:58.936664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.936664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:58.940166 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:58.940914 np0000000741 nova-compute[97948]: INFO os_vif [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e')
May 14 03:45:59.173779 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] End _get_guest_xml xml=<domain type="qemu">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <uuid>6e392e3e-de9b-4cf1-801e-29301cb35483</uuid>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <name>instance-0000003a</name>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestMinimumBasicScenario-server-733319753</nova:name>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:45:58</nova:creationTime>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:image uuid="ff695fdc-7169-4a4a-a269-34745541257b">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:user uuid="8f875de7ee454dd4ad6918c6794941f1">tempest-TestMinimumBasicScenario-1441934481-project-member</nova:user>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:project uuid="6af4cde5a4934c1e8d619ec5b8c8adc9">tempest-TestMinimumBasicScenario-1441934481</nova:project>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="ff695fdc-7169-4a4a-a269-34745541257b"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         <nova:port uuid="e6e095a8-b86a-4c33-b0e8-f1149c86ea7e">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <system>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="serial">6e392e3e-de9b-4cf1-801e-29301cb35483</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="uuid">6e392e3e-de9b-4cf1-801e-29301cb35483</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </system>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <os>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </os>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <features>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </features>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   <devices>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </disk>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:00:00:6e"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <target dev="tape6e095a8-b8"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </interface>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/console.log" append="off"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </serial>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <video>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </video>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </rng>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:   </devices>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]: </domain>
May 14 03:45:59.173779 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Preparing to wait for external event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:45:55Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.178678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbbb7b4-7ab3-5d3b-954a-b0f5f730900c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:59.179879 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:59.186885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.188897 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.189104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6e095a8-b8, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:59.189483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6e095a8-b8, col_values=(('qos', UUID('2433f55a-0f8e-4e05-b0ca-4e3dd507cab0')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:59.189672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6e095a8-b8, col_values=(('external_ids', {'iface-id': 'e6e095a8-b86a-4c33-b0e8-f1149c86ea7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:00:6e', 'vm-uuid': '6e392e3e-de9b-4cf1-801e-29301cb35483'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:45:59.190443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.191748 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:45:59.200622 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:45:59.201541 np0000000741 nova-compute[97948]: INFO os_vif [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8')
May 14 03:45:59.279111 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.910s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:45:59.279484 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:45:59.281624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.354s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:45:59.285948 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:45:59.286102 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Claim successful on node np0000000741
May 14 03:45:59.785982 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:45:59.786416 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:45:59.786883 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:59.787213 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:45:59.873548 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:46:00.290548 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:46:00.405935 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Successfully created port: 19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:46:00.461446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:00.461557 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:00.461698 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:00.461832 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:1c:30:f8, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:00.462332 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Using config drive
May 14 03:46:00.720146 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:00.720276 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:00.723657 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No VIF found with MAC fa:16:3e:00:00:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:00.723657 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Using config drive
May 14 03:46:00.799125 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:46:00.811035 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:00.987682 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:00.987911 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:01.010971 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.048509 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.049012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.079212 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Successfully updated port: 19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:46:01.144215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.173410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-changed-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:01.173410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Refreshing instance network info cache due to event network-changed-19c57b10-906a-4e89-853a-abc1119ff5e6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:01.173410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] Acquiring lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:01.173410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] Acquired lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:01.173410 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Refreshing network info cache for port 19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:01.182627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.189041 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:01.237150 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:01.304953 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Booting with volume 5a185670-7ae8-4ea7-826e-79af80defe6f at /dev/vda
May 14 03:46:01.365231 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:01.365438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:01.365613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:01.365776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:01.365918 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] No waiting events found dispatching network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:01.366072 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-4a75b27d-20c1-4e41-9c76-09edd95d8924 req-ff30dba8-d02e-4bf3-a2e7-a569c8e28da4 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received unexpected event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 for instance with vm_state building and task_state block_device_mapping.
May 14 03:46:01.377187 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:01.391812 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Creating config drive at /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config
May 14 03:46:01.394007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:46:01.396857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl176fcr0 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:01.425685 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:01.474157 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl176fcr0" returned: 0 in 0.076s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:01.480846 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:46:01.485858 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:46:01.492303 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:01.502244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:46:01.504542 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe13:bf2b', 'fe80::705c:47ff:fead:8736', 'fe80::fc16:3eff:fe1c:30f8'] 
May 14 03:46:01.504542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:46:01.504542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:46:01.504848 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:01.505091 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating existing volume attachment record: 8756a927-d6c3-478c-bc97-878b31266098 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:46:01.583027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:01.678282 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:01.766663 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:46:01.940277 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:01.995347 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.011831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.732s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:02.012221 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:46:02.028818 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.029267 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.079144 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730362.077326, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:02.079144 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Resumed (Lifecycle Event)
May 14 03:46:02.080241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:02.094134 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance running successfully.
May 14 03:46:02.100482 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Failed to set time: agent not configured {{(pid=97948) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 03:46:02.101007 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-36f5ec1b-15ca-4bd7-ae80-490d922d7bcf tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] finish_migration finished successfully. {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 03:46:02.157039 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.394515 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.396375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.399367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.423553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:02.442246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1a6bcd0-d896-4135-bbb3-89e2146dc92a req-f62951e8-544c-4f27-a618-b02dc0b989f9 service nova] Releasing lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:02.445205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:02.445333 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:02.526954 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:46:02.527237 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:46:02.527564 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:02.528076 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:02.584104 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:02.586768 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:02.619032 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '547494feb9d9440690768b7350f15860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43df7b9472f445dfbf816cb9b648332e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:46:03.029709 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:46:03.035471 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:46:03.089753 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:46:03.090101 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730363.0898805, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:03.090398 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Started (Lifecycle Event)
May 14 03:46:03.202599 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Successfully created port: 4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:46:03.246751 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:03.280541 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:03.281378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:03.281694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:03.282028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:03.282307 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Processing event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:46:03.282536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:03.283177 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:03.283496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:03.283927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:03.284089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:03.284396 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:03.284554 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-67ea1288-4edf-4956-8518-057abf72d051 req-8460e44b-1e33-43e4-a916-c4588771b1c0 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received unexpected event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with vm_state building and task_state spawning.
May 14 03:46:03.286989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:46:03.292399 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance spawned successfully.
May 14 03:46:03.294035 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:46:03.411845 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating instance_info_cache with network_info: [{"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:03.540808 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:46:03.593157 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:03.595186 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:03.671450 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:46:03.672351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:46:03.673085 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Creating image(s)
May 14 03:46:03.673498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:46:03.673782 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Ensure instance console log exists: /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:46:03.674705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:03.674912 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:03.675182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:03.780905 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Successfully updated port: 4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.801661 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:03.814182 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:03.869683 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-changed-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:03.869831 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Refreshing instance network info cache due to event network-changed-4936f21d-1236-469d-9dab-b5b584f81e0e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:03.869997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] Acquiring lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:03.870085 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] Acquired lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:03.870200 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Refreshing network info cache for port 4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:03.914271 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:03.914562 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance network_info: |[{"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:46:03.916315 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Start _get_guest_xml network_info=[{"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ec948257-bf93-4a61-9944-d5497f04e2ae', 'attached_at': '', 'detached_at': '', 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'serial': '5a185670-7ae8-4ea7-826e-79af80defe6f'}, 'boot_index': 0, 'attachment_id': '8756a927-d6c3-478c-bc97-878b31266098', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:46:03.918761 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:03.920562 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-944575287', uuid='ec948257-bf93-4a61-9944-d5497f04e2ae'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730363.9200847) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:46:03.922425 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:46:03.923129 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:46:03.924687 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:46:03.925179 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:46:03.926937 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:46:03.927530 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:46:03.928006 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:46:03.928344 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:46:03.928700 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:46:03.929752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:46:03.929752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:46:03.929752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:46:03.929752 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:46:03.930165 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:46:03.930507 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:46:03.930855 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:46:03.952014 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:46:03.952754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:03.953225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:03.954251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:03.954497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:46:03.969993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:03.970701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:03.971316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:03.971761 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:03.972710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:03.972710 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:03.986932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:03.986932 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:03.991799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:03.991799 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:04.003383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f] added
May 14 03:46:04.003383 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:04.003383 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:04.003383 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:04.003383 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:04.003383 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:04.003383 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:04.003754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:04.003872 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:04.004167 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:04.004993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f] added
May 14 03:46:04.004993 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:04.004993 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:04.004993 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:04.004993 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:04.004993 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:04.004993 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:04.005229 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:04.005267 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:04.005437 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:04.097581 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730364.0972624, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:04.097786 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Started (Lifecycle Event)
May 14 03:46:04.190953 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:04.285096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:04.306047 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Took 7.96 seconds to spawn the instance on the hypervisor.
May 14 03:46:04.306187 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:04.372470 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:04.475678 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:46:04.552149 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:46:04.552468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:46:04.552733 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Creating image(s)
May 14 03:46:04.553163 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:04.553326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:04.554038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:04.558656 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:04.558656 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:04.559415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:04.602506 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:04.624365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:04.680206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.121s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:04.681313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:04.681313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:04.681557 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:04.685178 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:04.686975 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:04.712448 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:04.712793 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:04.713192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Going to confirm migration 3 {{(pid=97948) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 03:46:04.716736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:04.721241 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:04.809416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.122s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:04.809991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:04.846775 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Took 13.64 seconds to build instance.
May 14 03:46:04.895357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk 1073741824" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:04.895778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:04.896173 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:05.002010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:05.003745 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:46:05.003745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:05.019103 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:05.020294 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:05.040128 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:05.040128 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:05.052324 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:05.052324 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.062992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.073255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.085669 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.094260 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.094948 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:05.132916 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.50.100,3260]
May 14 03:46:05.132916 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.50.100,3260] successful.
May 14 03:46:05.132916 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.133719 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730365.1332989, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:05.133973 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Paused (Lifecycle Event)
May 14 03:46:05.137553 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:05.138158 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Cannot resize image /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:46:05.139651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.40.100,3260]
May 14 03:46:05.139651 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.40.100,3260] successful.
May 14 03:46:05.139651 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.140404 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:46:05.140404 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Ensure instance console log exists: /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:46:05.140404 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:05.140632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:05.140722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:05.152870 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.162232 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.172376 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.173099 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:05.173099 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:05.173631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:05.174856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('9', '-', '-', 0) found on session 149 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:05.175358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:05.184731 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:05.184731 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:05.187926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('12', '-', '-', 0) found on session 150 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:05.187926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:05.200479 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 149 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:05.200783 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:05.218175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 150 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:05.218175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:05.233170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-dfd89f08-4fa5-4b64-82bd-020c6de51f0d req-1d5f08ac-475e-4505-88df-d81d220eadd0 service nova] Releasing lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:05.234381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquired lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:05.234670 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:05.237023 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:05.350002 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37ff2f42-8411-460c-acdd-6994600e0ea2 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:05.377502 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:05.377909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:05.378074 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:05.378253 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:05.378467 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'info_cache' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:05.638133 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:05.643563 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730365.643309, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:05.644437 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Resumed (Lifecycle Event)
May 14 03:46:05.820467 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:46:05.973431 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:46:06.052462 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:06.148791 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:06.155058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:06.255409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating instance_info_cache with network_info: [{"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:06.384811 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:06.389578 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:06.390221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:06.390221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:06.390221 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:06.390365 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:06.391100 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-4d23f974-186f-4f72-8818-9678bcb1addb req-c1c6e5d7-7d56-4954-b3cf-ca9c3d6edee4 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received unexpected event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with vm_state resized and task_state None.
May 14 03:46:06.743925 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:06.760666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Releasing lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:06.760666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance network_info: |[{"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:46:06.760666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Start _get_guest_xml network_info=[{"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:46:06.765926 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:06.766935 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1362708422', uuid='6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b'), owner=OwnerMeta(userid='547494feb9d9440690768b7350f15860', username='tempest-TestEncryptedCinderVolumes-402629128-project-member', projectid='43df7b9472f445dfbf816cb9b648332e', projectname='tempest-TestEncryptedCinderVolumes-402629128'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730366.7665637) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:46:06.768673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:46:06.768673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:46:06.769438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:46:06.769668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:46:06.771191 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:46:06.771871 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:46:06.772086 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:46:06.772797 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:46:06.772797 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:46:06.772797 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:46:06.772797 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:46:06.772985 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:46:06.773146 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:46:06.773315 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:46:06.773440 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:46:06.773691 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:46:06.794315 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1362708422',display_name='tempest-TestEncryptedCinderVolumes-server-1362708422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1362708422',id=60,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA43NCjuLfRMus0VQddn43CUF52bslIhCNvSt4jg+STmgrnnpDh8H1cF9+Dbiem8vo1C6UYZDtNgWM180Gy5hbGp5Qee2/7XEKIHn6s6RR6Aw8JM6u2hamnXjoIz3Xt8jw==',key_name='tempest-keypair-177846303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-kcexsyk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:46:06.794804 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:06.796760 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:06.798108 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'pci_devices' on Instance uuid 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:06.944742 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:06.990230 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000fee8789f for multipath device dm-2 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:46:06.990747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:06.991087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000fee8789f', 'path': '/dev/dm-2', 'multipath_id': '330000000fee8789f'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:06.991296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fee8789f', 'path': '/dev/dm-2', 'multipath_id': '330000000fee8789f'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:46:07.302435 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <uuid>6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b</uuid>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <name>instance-0000003c</name>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1362708422</nova:name>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:46:06</nova:creationTime>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:user uuid="547494feb9d9440690768b7350f15860">tempest-TestEncryptedCinderVolumes-402629128-project-member</nova:user>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:project uuid="43df7b9472f445dfbf816cb9b648332e">tempest-TestEncryptedCinderVolumes-402629128</nova:project>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         <nova:port uuid="4936f21d-1236-469d-9dab-b5b584f81e0e">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <system>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="serial">6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="uuid">6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </system>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <os>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </os>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <features>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </features>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   <devices>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.config"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:b0:a1:6e"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <target dev="tap4936f21d-12"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </interface>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/console.log" append="off"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </serial>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <video>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </video>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </rng>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:   </devices>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]: </domain>
May 14 03:46:07.302435 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Preparing to wait for external event network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1362708422',display_name='tempest-TestEncryptedCinderVolumes-server-1362708422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1362708422',id=60,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA43NCjuLfRMus0VQddn43CUF52bslIhCNvSt4jg+STmgrnnpDh8H1cF9+Dbiem8vo1C6UYZDtNgWM180Gy5hbGp5Qee2/7XEKIHn6s6RR6Aw8JM6u2hamnXjoIz3Xt8jw==',key_name='tempest-keypair-177846303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-kcexsyk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:46:07.305107 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:07.305673 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:07.305961 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:46:07.306385 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:07.306664 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:07.306950 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:46:07.310899 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:07.311111 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58a6568b-46f2-5e5c-a599-5ad60998a67f', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:07.312221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:07.313333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:07.315722 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:07.315920 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4936f21d-12, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:07.316261 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4936f21d-12, col_values=(('qos', UUID('38d80b95-e2f2-44c2-a060-29af69204d99')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:07.316429 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4936f21d-12, col_values=(('external_ids', {'iface-id': '4936f21d-1236-469d-9dab-b5b584f81e0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:a1:6e', 'vm-uuid': '6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:07.319723 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:07.323701 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:07.324617 np0000000741 nova-compute[97948]: INFO os_vif [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12')
May 14 03:46:07.423458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:07.423831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:07.446960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:07.447125 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'migration_context' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:07.497952 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-944575287',display_name='tempest-TestVolumeBootPattern-volume-backed-server-944575287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-volume-backed-server-944575287',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExF3qCnAqUnN5QqqvTtM7O204sfCXzZ1r1TrXF31Ah/Ab8uhe/C+XFHF3Y0/RT9zK6R7AYDxjTV/+x14uvhZd7UsuH3q4i0/qeWqwZbfU5Csw0h+aBS2YT81Ce0MbYPJQ==',key_name='tempest-keypair-1909072499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kl0tow2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=ec948257-bf93-4a61-9944-d5497f04e2ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:46:07.498214 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:07.498807 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:07.499398 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid ec948257-bf93-4a61-9944-d5497f04e2ae {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:07.927835 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:07.949284 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Object Instance<a2050a6c-1c7b-4454-8a7e-14960f06b79b> lazy-loaded attributes: info_cache,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:46:07.955706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:07.955944 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:08.003706 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] End _get_guest_xml xml=<domain type="qemu">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <uuid>ec948257-bf93-4a61-9944-d5497f04e2ae</uuid>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <name>instance-0000003b</name>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-944575287</nova:name>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:46:03</nova:creationTime>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         <nova:port uuid="19c57b10-906a-4e89-853a-abc1119ff5e6">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <system>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="serial">ec948257-bf93-4a61-9944-d5497f04e2ae</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="uuid">ec948257-bf93-4a61-9944-d5497f04e2ae</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </system>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <os>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </os>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <features>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </features>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   <devices>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/disk.config"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <alias name="ua-5a185670-7ae8-4ea7-826e-79af80defe6f"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-2"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <serial>5a185670-7ae8-4ea7-826e-79af80defe6f</serial>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:fb:7d:70"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <target dev="tap19c57b10-90"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </interface>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/console.log" append="off"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </serial>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <video>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </video>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </rng>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:   </devices>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]: </domain>
May 14 03:46:08.003706 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Preparing to wait for external event network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-944575287',display_name='tempest-TestVolumeBootPattern-volume-backed-server-944575287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-volume-backed-server-944575287',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExF3qCnAqUnN5QqqvTtM7O204sfCXzZ1r1TrXF31Ah/Ab8uhe/C+XFHF3Y0/RT9zK6R7AYDxjTV/+x14uvhZd7UsuH3q4i0/qeWqwZbfU5Csw0h+aBS2YT81Ce0MbYPJQ==',key_name='tempest-keypair-1909072499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kl0tow2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=ec948257-bf93-4a61-9944-d5497f04e2ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:46:08.006014 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:08.010102 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:08.010102 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:46:08.010301 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.010469 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:08.010652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:46:08.011656 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.012097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb0a7027-11d2-5da4-a1a4-89a48b842e22', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:08.012902 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.014139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:08.019389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.021501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.021781 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19c57b10-90, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:08.022154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19c57b10-90, col_values=(('qos', UUID('f1fc9e94-e644-4957-be08-1922b58d49ac')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:08.022427 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19c57b10-90, col_values=(('external_ids', {'iface-id': '19c57b10-906a-4e89-853a-abc1119ff5e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:7d:70', 'vm-uuid': 'ec948257-bf93-4a61-9944-d5497f04e2ae'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:08.023415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.024672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:08.039724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.039724 np0000000741 nova-compute[97948]: INFO os_vif [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90')
May 14 03:46:08.349203 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.469572 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:08.470201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:08.470438 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:08.470666 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:08.470872 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:08.471009 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-95b868be-4853-4820-9c91-916db1963089 req-b764c584-929a-4a15-a347-0e19ead685fd service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received unexpected event network-vif-plugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with vm_state resized and task_state None.
May 14 03:46:08.816349 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:08.851536 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:08.851680 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:08.851768 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:b0:a1:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:08.852206 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Using config drive
May 14 03:46:08.942479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:09.014505 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:09.014828 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:09.360881 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:09.508954 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Creating config drive at /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.config
May 14 03:46:09.517021 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwglgz2xr {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:09.532253 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:09.561181 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:09.561317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:09.561438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:fb:7d:70, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:09.561991 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Using config drive
May 14 03:46:09.581112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwglgz2xr" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:10.053954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:10.054990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:10.055200 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attaching volume b80d657f-55ec-4146-ad3d-7224c7fae26a to /dev/vdb
May 14 03:46:10.064145 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.076915 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:10.094583 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.099625 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.126190 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:10.145800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:46:10.171941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:10.206919 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.231188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:46:10.231831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe13:bf2b', 'fe80::705c:47ff:fead:8736', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:fe00:6e', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:feb0:a16e'] 
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:10.245690 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating existing volume attachment record: 607102dc-1bb3-48c8-a0b6-0618c762c981 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:46:10.270173 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Creating config drive at /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/disk.config
May 14 03:46:10.274538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcej8ic6g {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:10.318664 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ed7c7672-6b38-4587-a20e-e8e6dd603b6d req-0747f945-0f2c-4618-b89b-f573cd802047 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:10.318664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ed7c7672-6b38-4587-a20e-e8e6dd603b6d req-0747f945-0f2c-4618-b89b-f573cd802047 service nova] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:10.318664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ed7c7672-6b38-4587-a20e-e8e6dd603b6d req-0747f945-0f2c-4618-b89b-f573cd802047 service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:10.318664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ed7c7672-6b38-4587-a20e-e8e6dd603b6d req-0747f945-0f2c-4618-b89b-f573cd802047 service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:10.318664 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ed7c7672-6b38-4587-a20e-e8e6dd603b6d req-0747f945-0f2c-4618-b89b-f573cd802047 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Processing event network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:46:10.349756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcej8ic6g" returned: 0 in 0.075s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:10.437916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.447211 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.450783 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.482131 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.497501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.564510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.607s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:10.825331 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:46:10.825926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:10.826390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:10.826929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:10.827328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:46:10.845447 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:10.846010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:10.847824 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:10.848510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:10.848896 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:10.849779 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:10.859679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:10.869417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:10.869417 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:10.878558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:10.878558 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:10.885044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a] added
May 14 03:46:10.885044 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:10.885044 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:10.885044 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:10.885044 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:10.885044 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:10.885044 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:10.885446 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:10.887530 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:10.887530 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a] added
May 14 03:46:10.893011 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:10.893011 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0444(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:10.893011 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:10.904654 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:11.004607 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:11.146669 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:11.147426 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730371.1465104, 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:11.147593 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] VM Started (Lifecycle Event)
May 14 03:46:11.153260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:46:11.156427 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance spawned successfully.
May 14 03:46:11.156427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:46:11.195402 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocation for migration 9f54ed9c-3b75-42ec-b113-d37694af14ce
May 14 03:46:11.206841 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:11.212278 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:11.239860 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:11.337145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:11.337376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:11.651399 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:11.654014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:11.665957 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.666104 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.666382 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.666714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.667060 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.667366 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:11.700001 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-70009174-669e-46f9-b3f5-6e70e38830f0 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.987s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:11.839860 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:46:11.888613 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:11.893539 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:11.911488 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:11.911488 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:11.914890 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:11.914890 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:11.931155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:11.950701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.961414 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.961760 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.973826 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:11.974084 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:12.006299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260]
May 14 03:46:12.006299 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260] successful.
May 14 03:46:12.006299 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:12.021748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:12.033671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260]
May 14 03:46:12.033671 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260] successful.
May 14 03:46:12.033671 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:12.043554 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.047463 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.047873 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:12.048245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:12.048389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:12.049656 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('15', '-', '-', 0) found on session 151 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:12.049806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:12.068950 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 151 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:12.069088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.071310 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:12.071572 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:12.072024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:12.072024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:12.074160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('16', '-', '-', 0) found on session 152 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:12.074160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:12.095505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 152 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:12.095774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:12.162402 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:46:12.163034 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730372.162474, 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:12.163260 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] VM Paused (Lifecycle Event)
May 14 03:46:12.175111 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Took 7.62 seconds to spawn the instance on the hypervisor.
May 14 03:46:12.175341 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:12.394557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:12.394557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:12.398965 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:46:12.399277 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Claim successful on node np0000000741
May 14 03:46:12.419489 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:12.419688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:12.419942 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:12.420041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:12.420175 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] No waiting events found dispatching network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:12.421413 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-67942f8a-d2ec-40f7-bb6e-419a9d9e1784 req-8848a125-0241-4ba8-8e6e-7c88d47b866e service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received unexpected event network-vif-plugged-4936f21d-1236-469d-9dab-b5b584f81e0e for instance with vm_state active and task_state None.
May 14 03:46:12.666054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:12.668144 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730372.6678853, 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:12.668303 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] VM Resumed (Lifecycle Event)
May 14 03:46:12.687267 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Took 15.83 seconds to build instance.
May 14 03:46:12.848768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:46:13.023658 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:13.151668 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:13.151805 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing instance network info cache due to event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:13.152023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:13.152143 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:13.152326 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:13.170872 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:13.173114 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:13.188771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bab4963c-e706-45be-a98c-3b628d15f28d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.343s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:13.655021 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:13.675799 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730373.6754076, ec948257-bf93-4a61-9944-d5497f04e2ae => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:13.675993 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] VM Started (Lifecycle Event)
May 14 03:46:13.819955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:13.867477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found WWN 33000000096054cf3 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:46:13.871124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:13.871424 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000096054cf3', 'path': '/dev/dm-5', 'multipath_id': '33000000096054cf3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:13.871833 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000096054cf3', 'path': '/dev/dm-5', 'multipath_id': '33000000096054cf3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:46:13.875775 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:14.063840 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:14.068065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:14.068495 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:14.178627 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:14.182429 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730374.1821043, ec948257-bf93-4a61-9944-d5497f04e2ae => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:14.182862 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] VM Paused (Lifecycle Event)
May 14 03:46:14.237294 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updated VIF entry in instance network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:14.238365 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:14.379190 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attempting to attach volume b80d657f-55ec-4146-ad3d-7224c7fae26a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:46:14.381604 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:   <alias name="ua-b80d657f-55ec-4146-ad3d-7224c7fae26a"/>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-5"/>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:   <serial>b80d657f-55ec-4146-ad3d-7224c7fae26a</serial>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]: </disk>
May 14 03:46:14.381604 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:46:14.571813 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:14.610086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2181f738-e87a-4d2d-a2e7-456432bc48b8 req-319bee68-00bf-4194-bda5-64e414f805b4 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:14.610827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f738-e87a-4d2d-a2e7-456432bc48b8 req-319bee68-00bf-4194-bda5-64e414f805b4 service nova] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:14.611026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f738-e87a-4d2d-a2e7-456432bc48b8 req-319bee68-00bf-4194-bda5-64e414f805b4 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:14.611209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2181f738-e87a-4d2d-a2e7-456432bc48b8 req-319bee68-00bf-4194-bda5-64e414f805b4 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:14.611387 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2181f738-e87a-4d2d-a2e7-456432bc48b8 req-319bee68-00bf-4194-bda5-64e414f805b4 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Processing event network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:46:14.611786 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:14.614613 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:46:14.620632 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance spawned successfully.
May 14 03:46:14.620961 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:46:14.685499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:14.687307 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730374.687092, ec948257-bf93-4a61-9944-d5497f04e2ae => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:14.687435 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] VM Resumed (Lifecycle Event)
May 14 03:46:14.740831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e10f2b31-c0ea-413e-b697-8bd39ea8307f req-c70f7f56-aa2d-4e46-bf57-7221bee7305d service nova] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:15.083600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.689s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:15.084118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:46:15.132835 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.133031 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.134034 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.134380 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.135037 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.135234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:15.189901 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:15.195655 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:15.253488 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:15.256747 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing instance network info cache due to event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:15.256747 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:15.256747 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:15.256747 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:15.591318 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:46:15.593863 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:46:15.593863 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:15.593863 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:15.645219 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Took 11.97 seconds to spawn the instance on the hypervisor.
May 14 03:46:15.649452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:15.703194 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cd05bb8cd0642019599037e8f145541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593121a21a7440a48c3f9ec54b7811bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:46:15.706292 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:46:15.759315 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:16.066437 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:16.066673 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:16.066993 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:16.067150 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No VIF found with MAC fa:16:3e:00:00:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:16.095896 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:46:16.152007 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:16.164765 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Took 19.88 seconds to build instance.
May 14 03:46:16.319319 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Successfully created port: d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:46:16.347314 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updated VIF entry in instance network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:16.347653 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:16.603808 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:46:16.668884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.392s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:16.705141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:16.705617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:16.705846 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:16.705967 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:16.706100 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] No waiting events found dispatching network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:16.706225 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-7608b71c-c0b9-4faf-8175-f35d06a69240 req-a3b2ddf9-c4e9-445e-af78-7e0ef450a050 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received unexpected event network-vif-plugged-19c57b10-906a-4e89-853a-abc1119ff5e6 for instance with vm_state active and task_state None.
May 14 03:46:16.851726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:16.851934 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-changed-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:16.852014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Refreshing instance network info cache due to event network-changed-4936f21d-1236-469d-9dab-b5b584f81e0e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:16.852130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Acquiring lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:16.852257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Acquired lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:16.852381 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Refreshing network info cache for port 4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:16.981213 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Successfully updated port: d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:46:17.354500 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:17.484748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:17.484869 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquired lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:17.485013 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:17.622041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:46:17.626009 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:46:17.626009 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Creating image(s)
May 14 03:46:17.626009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:17.626009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:17.626391 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:17.627054 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:17.634974 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:17.638293 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:17.679342 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6cc80712-8607-4dd8-8f80-bb02d2067bbf tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.623s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:17.767688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.131s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:17.768406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:17.769065 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:17.769676 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:17.773688 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:46:17.774125 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:17.843921 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:17.897242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.123s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:17.899579 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:17.969191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk 1073741824" returned: 0 in 0.071s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:17.969851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:17.970250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:18.025582 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:18.061110 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updated VIF entry in instance network info cache for port 4936f21d-1236-469d-9dab-b5b584f81e0e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:18.061710 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating instance_info_cache with network_info: [{"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:18.079984 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:46:18.084879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:18.088518 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:46:18.088518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:18.201067 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:18.201677 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Cannot resize image /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:46:18.202128 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:46:18.202433 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Ensure instance console log exists: /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:46:18.202875 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:18.203220 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:18.203494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:18.274327 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:18.429657 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:18.565703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-86f33131-0d19-4abf-88b3-20dc8d6bef10 req-8024c002-3284-4b54-b00b-42d938d2e444 service nova] Releasing lock "refresh_cache-6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:18.811842 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:18.811973 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing instance network info cache due to event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:18.812110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Acquiring lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:18.822383 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:18.932817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Releasing lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:18.933196 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Instance network_info: |[{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:46:18.936711 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Start _get_guest_xml network_info=[{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:46:18.936711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Acquired lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:18.936711 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:18.940090 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:18.941808 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1466566586', uuid='39304f73-2e21-43f5-a634-2e1f42124be5'), owner=OwnerMeta(userid='8cd05bb8cd0642019599037e8f145541', username='tempest-TestStampPattern-671027015-project-member', projectid='593121a21a7440a48c3f9ec54b7811bd', projectname='tempest-TestStampPattern-671027015'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730378.9413254) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:46:18.945481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:46:18.946337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:46:18.949174 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:46:18.950103 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:46:18.951346 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:46:18.951922 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:46:18.953659 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:46:18.980029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1466566586',display_name='tempest-TestStampPattern-server-1466566586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1466566586',id=61,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-7d1iiqsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:17Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=39304f73-2e21-43f5-a634-2e1f42124be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:46:18.981827 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:18.981827 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:18.983889 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'pci_devices' on Instance uuid 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:19.439064 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:19.489449 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] End _get_guest_xml xml=<domain type="qemu">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <uuid>39304f73-2e21-43f5-a634-2e1f42124be5</uuid>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <name>instance-0000003d</name>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestStampPattern-server-1466566586</nova:name>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:46:18</nova:creationTime>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:user uuid="8cd05bb8cd0642019599037e8f145541">tempest-TestStampPattern-671027015-project-member</nova:user>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:project uuid="593121a21a7440a48c3f9ec54b7811bd">tempest-TestStampPattern-671027015</nova:project>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         <nova:port uuid="d0b4176c-966a-40f9-bb20-18922b0ebe3c">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <system>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="serial">39304f73-2e21-43f5-a634-2e1f42124be5</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="uuid">39304f73-2e21-43f5-a634-2e1f42124be5</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </system>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <os>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </os>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <features>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </features>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   <devices>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.config"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5d:fa:18"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <target dev="tapd0b4176c-96"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </interface>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/console.log" append="off"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </serial>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <video>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </video>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </rng>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:   </devices>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]: </domain>
May 14 03:46:19.489449 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Preparing to wait for external event network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1466566586',display_name='tempest-TestStampPattern-server-1466566586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1466566586',id=61,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-7d1iiqsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:17Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=39304f73-2e21-43f5-a634-2e1f42124be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:46:19.498780 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:19.501184 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:19.501184 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:46:19.501908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.502218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:19.502697 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:46:19.506477 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.507140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6adda708-b8e3-5e72-8f33-97ea7be89eac', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:19.522959 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.525541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:19.526815 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.527095 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b4176c-96, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:19.527594 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b4176c-96, col_values=(('qos', UUID('eaa94c66-a14d-487a-af1b-3f02cbfe0d0c')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:19.527930 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b4176c-96, col_values=(('external_ids', {'iface-id': 'd0b4176c-966a-40f9-bb20-18922b0ebe3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:fa:18', 'vm-uuid': '39304f73-2e21-43f5-a634-2e1f42124be5'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:19.530672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.530762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:19.540735 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:19.542239 np0000000741 nova-compute[97948]: INFO os_vif [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96')
May 14 03:46:19.788818 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:19.950930 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updated VIF entry in instance network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:19.951212 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:20.331580 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:20.331580 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing instance network info cache due to event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:20.331960 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:20.332178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:20.332578 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:20.453469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Releasing lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:20.453996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-changed-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:20.453996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Refreshing instance network info cache due to event network-changed-19c57b10-906a-4e89-853a-abc1119ff5e6. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:20.455075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Acquiring lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:20.455383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Acquired lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:20.455533 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Refreshing network info cache for port 19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:20.838403 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:20.957954 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:21.075817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:21.075817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:21.075817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No VIF found with MAC fa:16:3e:5d:fa:18, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:21.075817 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Using config drive
May 14 03:46:21.238418 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:21.412304 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:21.424301 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updated VIF entry in instance network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:21.424446 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:21.583292 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:21.608851 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updated VIF entry in instance network info cache for port 19c57b10-906a-4e89-853a-abc1119ff5e6. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:21.609231 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating instance_info_cache with network_info: [{"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:21.717424 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Creating config drive at /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.config
May 14 03:46:21.721721 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf_ip7geo {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:21.786610 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf_ip7geo" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:21.788072 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:21.788632 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:21.926961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a8f5dd9c-95ab-4931-b31c-771340f6d5c1 req-25200bdb-109f-4562-aa6b-63915041e8c6 service nova] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:22.111817 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6cfe8435-a786-4f99-8995-34d5a860c808 req-a86725a0-ec93-4804-8bb0-dd256fa9d740 service nova] Releasing lock "refresh_cache-ec948257-bf93-4a61-9944-d5497f04e2ae" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:22.137303 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:22.137540 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing instance network info cache due to event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:22.137767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:22.137913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:22.138363 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:22.290993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.324391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.425340 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.505313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a900cd6b-4255-4221-b192-2daa85044960 req-850c2f8f-5d27-4e7e-9c45-7b0283107592 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:22.505313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a900cd6b-4255-4221-b192-2daa85044960 req-850c2f8f-5d27-4e7e-9c45-7b0283107592 service nova] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:22.505313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a900cd6b-4255-4221-b192-2daa85044960 req-850c2f8f-5d27-4e7e-9c45-7b0283107592 service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:22.505313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a900cd6b-4255-4221-b192-2daa85044960 req-850c2f8f-5d27-4e7e-9c45-7b0283107592 service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:22.505313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a900cd6b-4255-4221-b192-2daa85044960 req-850c2f8f-5d27-4e7e-9c45-7b0283107592 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Processing event network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:46:22.641368 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:22.666209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.669872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.676135 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:22.703087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:23.028251 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:23.201427 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updated VIF entry in instance network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:23.202542 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:23.216756 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730383.2150128, 39304f73-2e21-43f5-a634-2e1f42124be5 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:23.216756 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] VM Started (Lifecycle Event)
May 14 03:46:23.217631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:23.221914 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:46:23.224894 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Instance spawned successfully.
May 14 03:46:23.225228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:46:23.705025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5152554-8539-4d79-9ed9-921c8be50794 req-f3a7c7e8-2604-44ed-8518-98d630f36797 service nova] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:23.720025 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:23.723568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:23.733946 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.734179 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.734718 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.735138 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.735852 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.736296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:46:23.778909 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:23.779661 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:23.785422 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:23.785802 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:23.823917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:24.228783 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:46:24.229072 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730384.2288465, 39304f73-2e21-43f5-a634-2e1f42124be5 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:24.229219 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] VM Paused (Lifecycle Event)
May 14 03:46:24.243229 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Took 6.62 seconds to spawn the instance on the hypervisor.
May 14 03:46:24.243415 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:24.267251 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:24.267864 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing instance network info cache due to event network-changed-330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:24.268096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] Acquiring lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:24.268267 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] Acquired lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:24.268435 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Refreshing network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:24.528918 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:24.581127 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:24.584873 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:24.585053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:24.585173 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:24.585339 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] No waiting events found dispatching network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:24.585489 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-7afb164b-2548-4d12-9bd7-eca9e7a518b1 req-abaf7188-83df-4840-acac-158aa49a7558 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received unexpected event network-vif-plugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c for instance with vm_state active and task_state None.
May 14 03:46:24.731919 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:24.734075 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730384.7338092, 39304f73-2e21-43f5-a634-2e1f42124be5 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:24.734305 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] VM Resumed (Lifecycle Event)
May 14 03:46:24.751975 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Took 12.41 seconds to build instance.
May 14 03:46:24.770871 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:24.795709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:24.795896 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:24.796097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:24.796259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:24.797432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:24.801654 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Terminating instance
May 14 03:46:25.082908 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:25.221395 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updated VIF entry in instance network info cache for port 330c93e3-db19-45ff-8ea9-4bcfb3a407be. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:25.221666 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [{"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:25.236869 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:25.240279 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:25.253215 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-523f25bb-bc7b-4b8d-86b4-284b39cf4f1e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.916s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:25.306779 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:46:25.338464 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:25.342260 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:25.368526 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:25.376869 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:25.406801 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:25.645344 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Instance destroyed successfully.
May 14 03:46:25.647044 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lazy-loading 'resources' on Instance uuid 826d2019-5737-4c3a-bd55-841fd6c6fb86 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:25.724136 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e66b6e9d-1bfa-4fcc-b23a-ff48833a2823 req-8492b403-94a6-41b7-a2bd-a57f56df4171 service nova] Releasing lock "refresh_cache-826d2019-5737-4c3a-bd55-841fd6c6fb86" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:25.742749 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999712730000283 future=<Future at 0x79d09073a5a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:25.743266 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999395073999949 future=<Future at 0x79d09073a5a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:25.743266 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999258252000345 future=<Future at 0x79d09073a5a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:26.149411 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1512050129',display_name='tempest-TestVolumeBackupRestore-server-1512050129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebackuprestore-server-1512050129',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8aNgisB1Lv/2zIMDjQkswkEcOQL7QJ5uX+PiOPEq9b3BVbrlPLpDQ4+EPAY2M83Y+IK2wJ8+04554/RTb9koKUIrDMg6G8EE0WTowcwohe67vfICY9MuKPuNiQuKVCxQ==',key_name='tempest-TestVolumeBackupRestore-1069183106',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:45:49Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b797253645468a8756aece06837896',ramdisk_id='',reservation_id='r-mv6qv0x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1546488814',owner_user_name='tempest-TestVolumeBackupRestore-1546488814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:45:50Z,user_data=None,user_id='51edcd1c632e43b5bdb146cbebe907af',uuid=826d2019-5737-4c3a-bd55-841fd6c6fb86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:46:26.149722 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converting VIF {"id": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "address": "fa:16:3e:13:bf:2b", "network": {"id": "479cf04a-5653-4977-b78c-83b743573be6", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1099813866-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60b797253645468a8756aece06837896", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c93e3-db", "ovs_interfaceid": "330c93e3-db19-45ff-8ea9-4bcfb3a407be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:26.150208 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:26.150450 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:46:26.151884 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:26.152460 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap330c93e3-db, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:26.154154 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:26.159548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:26.161009 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:26.161198 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d204fc4-5930-439a-bb93-89da289455cd) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:26.161748 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:26.162349 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:26.162493 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:26.165301 np0000000741 nova-compute[97948]: INFO os_vif [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:bf:2b,bridge_name='br-int',has_traffic_filtering=True,id=330c93e3-db19-45ff-8ea9-4bcfb3a407be,network=Network(479cf04a-5653-4977-b78c-83b743573be6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c93e3-db')
May 14 03:46:26.167097 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:46:26.167627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:26.167900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:26.168403 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:26.168851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:46:26.169036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1 (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:26.202049 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:26.202049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '152')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:46:26.202559 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '147')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:46:26.204348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1', '148')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:46:26.204896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0037c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:46:26.205147 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:46:26.205428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Flush multipath device 330000000479ff130 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:46:26.265335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:46:26.321190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:46:26.365296 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:46:26.365532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:46:26.366755 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:46:26.378098 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:46:26.378368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:46:26.389181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.426060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.40.100,3260]
May 14 03:46:26.426060 np0000000741 nova-compute[97948]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.40.100,3260] successful.
May 14 03:46:26.426060 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.444676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.457398 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.491202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.50.100,3260]
May 14 03:46:26.491202 np0000000741 nova-compute[97948]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b0f9a6fa-6439-4dea-9415-41efaea6c9c1, portal: 192.168.50.100,3260] successful.
May 14 03:46:26.491202 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.508312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:26.508533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:26.508700 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] <== disconnect_volume: return (341ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:26.508774 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:46:26.508996 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Deleting instance files /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86_del
May 14 03:46:26.510477 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Deletion of /opt/stack/data/nova/instances/826d2019-5737-4c3a-bd55-841fd6c6fb86_del complete
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] No waiting events found dispatching network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Acquiring lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] No waiting events found dispatching network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:26.648662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-741c7dcc-eae6-413f-9989-b63a558c86a3 req-9d34ab89-7968-4977-bcad-c4d0a59584ec service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-unplugged-330c93e3-db19-45ff-8ea9-4bcfb3a407be for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:46:27.017382 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Took 1.71 seconds to destroy the instance on the hypervisor.
May 14 03:46:27.017382 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:46:27.017382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:46:27.017382 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:46:27.017382 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:27.084943 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:27.443332 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:27.443626 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing instance network info cache due to event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:46:27.443695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] Acquiring lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:27.443838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] Acquired lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:27.443914 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:46:27.783967 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:27.784171 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:27.863845 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:27.945716 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:28.289109 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:28.365833 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Took 1.35 seconds to deallocate network for instance.
May 14 03:46:28.442885 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updated VIF entry in instance network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:46:28.443250 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:28.711704 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f93276b6-2cf6-42c9-a7e2-d76d2e729250 req-3c140a71-ce47-490f-8aff-e2887cb2b7bb service nova] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Received event network-vif-deleted-330c93e3-db19-45ff-8ea9-4bcfb3a407be {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:28.783160 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:28.783319 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:46:28.783503 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:28.828826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:28.931217 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Took 0.56 seconds to detach 1 volumes for instance.
May 14 03:46:28.946227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0d9d8b16-beb7-43ef-bda3-92ed196f58aa req-de818126-d5ee-4674-ace5-c88a9d412108 service nova] Releasing lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:29.287827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:29.288043 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:29.288248 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:29.288431 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:46:29.437110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:29.437719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:29.988376 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:29.988654 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:30.336230 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.454094 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.454819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.493609 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:30.579380 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.579748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:30.583296 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.671827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.672431 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.764050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.768144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.871322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.872019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:30.958333 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:30.958784 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:30.962505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.005400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.568s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:31.050396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.051050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.072542 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Deleted allocations for instance 826d2019-5737-4c3a-bd55-841fd6c6fb86
May 14 03:46:31.135736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.139234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.164254 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:31.239319 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.240014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.344601 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.349025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.444932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.445455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.543284 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.547466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:31.549002 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.647345 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.649556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.745755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.748344 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:31.750715 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:31.752454 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:31.755091 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:31.802524 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:31.804282 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=11238MB free_disk=72.73666000366211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:46:31.804282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:31.804282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:32.090531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3a5377e-5fd4-494d-a454-3cc0c0372659 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Lock "826d2019-5737-4c3a-bd55-841fd6c6fb86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.295s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:32.875053 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 608384f9-6f6b-428e-a519-f1631dc5deb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a2050a6c-1c7b-4454-8a7e-14960f06b79b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 6e392e3e-de9b-4cf1-801e-29301cb35483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ec948257-bf93-4a61-9944-d5497f04e2ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 39304f73-2e21-43f5-a634-2e1f42124be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:46:32.877513 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2304MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:46:31 up 38 min,  2 users,  load average: 6.82, 6.74, 4.85\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '9', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '5', 'io_workload': '0', 'num_proj_6af4cde5a4934c1e8d619ec5b8c8adc9': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1', 'num_proj_43df7b9472f445dfbf816cb9b648332e': '1', 'num_proj_593121a21a7440a48c3f9ec54b7811bd': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:46:33.522012 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:33.522236 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:33.831510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:34.025177 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:34.503655 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Stashing vm_state: active {{(pid=97948) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 03:46:34.535187 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:46:34.535187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:34.535931 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:35.078249 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:35.078621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:35.535537 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:35.535773 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:35.535985 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:46:35.536252 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.25 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:35.586210 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:46:35.586482 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Claim successful on node np0000000741
May 14 03:46:35.880373 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:36.093316 np0000000741 nova-compute[97948]: INFO nova.compute.resource_tracker [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating resource usage from migration e3ccf7d6-a763-4845-b5f9-ee588593ad10
May 14 03:46:36.165164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:36.749447 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:46:36.749730 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:46:36.805518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:36.805735 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:36.805976 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Rebooting instance
May 14 03:46:37.252935 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:46:37.358788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:37.358917 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:37.359008 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:37.760702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.682s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:37.760840 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Migrating
May 14 03:46:37.761000 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:46:37.822001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:37.860959 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:38.191804 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:38.277751 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:38.278229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:38.278229 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:38.344091 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:38.507851 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:46:38.781276 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:38.830037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:38.848678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:39.122760 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:39.250771 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:39.352215 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:39.752594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:40.393144 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.401669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.424889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.433372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.461265 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.625722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:40.625722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:40.625722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:40.625722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:40.625722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:40.625920 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-58dd738d-1fe6-401b-bfa0-ac03dc6ed09e req-f90af6b2-d5c9-4229-b2ec-0f2a494d7484 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received unexpected event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with vm_state active and task_state reboot_started_hard.
May 14 03:46:40.667376 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.674129 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:40.700983 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999582560000363 future=<Future at 0x79d0b843c920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:40.702431 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance destroyed successfully.
May 14 03:46:40.703006 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'resources' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:40.743787 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0013671749998138694 future=<Future at 0x79d09073a5a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:40.743881 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:40.744071 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.956503664000138 future=<Future at 0x79d0b843c920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:40.744278 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.956337898000129 future=<Future at 0x79d0b843c920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:40.745274 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] Emitting event <LifecycleEvent: 1778730385.7423027, 826d2019-5737-4c3a-bd55-841fd6c6fb86 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:40.745735 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] VM Stopped (Lifecycle Event)
May 14 03:46:41.166762 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.205372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:04Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:39Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:46:41.205727 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:41.206333 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:41.206568 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:46:41.209856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.210110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6e095a8-b8, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:41.211790 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.214563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:41.215213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.215424 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2433f55a-0f8e-4e05-b0ca-4e3dd507cab0) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:41.218004 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:41.219355 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8')
May 14 03:46:41.220742 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:46:41.221059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:41.221199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:41.221654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:41.222037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:46:41.222207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:46:41.252291 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f819f57-aa5c-4682-ba7e-c7ba05d1c3a9 tempest-TestVolumeBackupRestore-1546488814 tempest-TestVolumeBackupRestore-1546488814-project-member] [instance: 826d2019-5737-4c3a-bd55-841fd6c6fb86] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:41.253517 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:41.254085 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '152')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:46:41.254085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '152')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:46:41.255876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '151')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:46:41.257095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0230ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:46:41.257393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Removing multipathed devices sdk, sdj {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:46:41.257759 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flush multipath device 33000000096054cf3 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:46:41.266921 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Starting migrate_disk_and_power_off {{(pid=97948) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 03:46:41.292867 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.299076 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.299478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:46:41.328710 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.346145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:46:41.395305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:46:41.395811 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:46:41.396626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:46:41.409735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:46:41.410030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:46:41.423980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.454888 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.460012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260]
May 14 03:46:41.460012 np0000000741 nova-compute[97948]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260] successful.
May 14 03:46:41.460012 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.462179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.482899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.497980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.521225 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:41.521446 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:41.521697 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:41.521850 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:41.522011 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:41.522071 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-a72e0a08-c7dd-4074-a39c-20fa49918d18 req-ddec5597-8adb-435a-94e8-cd4d571f67eb service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received unexpected event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with vm_state active and task_state resize_migrating.
May 14 03:46:41.547341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260]
May 14 03:46:41.547341 np0000000741 nova-compute[97948]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260] successful.
May 14 03:46:41.547341 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.567184 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:41.567586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:41.567729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== disconnect_volume: return (346ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:41.568006 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:46:41.575755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start _get_guest_xml network_info=[{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff695fdc-7169-4a4a-a269-34745541257b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': 'ff695fdc-7169-4a4a-a269-34745541257b'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '6e392e3e-de9b-4cf1-801e-29301cb35483', 'attached_at': '', 'detached_at': '', 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'serial': 'b80d657f-55ec-4146-ad3d-7224c7fae26a'}, 'boot_index': None, 'attachment_id': '607102dc-1bb3-48c8-a0b6-0618c762c981', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:46:41.589317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.594525 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:41.594525 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ff695fdc-7169-4a4a-a269-34745541257b', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-733319753', uuid='6e392e3e-de9b-4cf1-801e-29301cb35483'), owner=OwnerMeta(userid='8f875de7ee454dd4ad6918c6794941f1', username='tempest-TestMinimumBasicScenario-1441934481-project-member', projectid='6af4cde5a4934c1e8d619ec5b8c8adc9', projectname='tempest-TestMinimumBasicScenario-1441934481'), image=ImageMeta(id='ff695fdc-7169-4a4a-a269-34745541257b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730401.5940616) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:46:41.596660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:46:41.597171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:46:41.598606 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.599310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:46:41.599556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:46:41.600683 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:46:41.600986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff695fdc-7169-4a4a-a269-34745541257b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:46:41.601201 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:46:41.601346 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:46:41.601551 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:46:41.601704 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:46:41.601840 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:46:41.602036 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:46:41.602172 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:46:41.602331 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:46:41.602473 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:46:41.602630 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:46:41.604330 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:41.631767 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999730924000232 future=<Future at 0x79d0b04808c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:41.636199 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance destroyed successfully.
May 14 03:46:41.636199 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:45:08Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:46:41.636199 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:41.636199 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:41.636199 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:46:41.639755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.640078 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9133ed-ac, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:41.641284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.643179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:41.645081 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.646425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.646650 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b86df82-4887-4937-9d5c-f2ef095f814d) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:41.647605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.647960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:41.648775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:41.651304 np0000000741 nova-compute[97948]: INFO os_vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac')
May 14 03:46:42.035334 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:42.108665 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Object Instance<6e392e3e-de9b-4cf1-801e-29301cb35483> lazy-loaded attributes: resources,vcpu_model {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:46:42.121870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.188428 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Detected multiple connections on this host for volume: 68afeadc-26f9-4d0e-a964-e15575723cb9, skipping target disconnect.
May 14 03:46:42.195526 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.221120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.222826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:42.222826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:42.223891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:42.224726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:46:42.225597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:42.225838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:42.226315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:42.226586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:46:42.239396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:42.240414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:42.241081 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:42.241344 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:42.241874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:42.242079 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:42.257918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:42.257918 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:42.259711 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:42.259711 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:42.270072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a] added
May 14 03:46:42.270072 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:42.270072 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:42.270072 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:42.270072 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:42.270072 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:42.270072 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:42.270441 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:42.271346 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:42.271346 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:42.275419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a] added
May 14 03:46:42.275419 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:42.275419 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:42.275419 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:42.275419 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:42.275419 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:42.275419 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:42.275682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:42.275758 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:42.275901 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:42.319713 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.321468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.412994 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.416707 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:42.416707 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.533775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.533775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk.config /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.583372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk.config /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.586726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk.info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:42.640245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "cp -r /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_resize/disk.info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:42.690051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:42.690916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:42.690916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:42.691078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:42.691279 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:42.691422 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-c9096625-4530-4bf8-958f-4dab498df271 req-ab88f4d3-636c-44b8-bf8f-7c6ff9d21ac1 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received unexpected event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with vm_state active and task_state reboot_started_hard.
May 14 03:46:43.271549 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:43.276725 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:43.289927 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:43.289927 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:43.302332 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:43.302332 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.305992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.318538 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.331388 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.331819 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.337870 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:43.370440 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260]
May 14 03:46:43.370440 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260] successful.
May 14 03:46:43.370440 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.384718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.394748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260]
May 14 03:46:43.394748 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260] successful.
May 14 03:46:43.394748 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.403769 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.404165 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:43.404443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:43.404443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:43.405450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('7', '-', '-', 0) found on session 153 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:43.405577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:43.411358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:43.426860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 153 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:43.427235 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.429253 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:43.429469 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:43.429809 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:43.429931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:43.430846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('8', '-', '-', 0) found on session 154 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:43.430961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:43.450196 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 154 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:43.450196 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:43.636112 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:43.636112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:43.636112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:43.636310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:43.636650 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:43.636650 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1c8b9aae-eba4-43e4-8c9f-d6f44c0295ff req-e4dda523-80b9-47df-b213-7849afa791c8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received unexpected event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with vm_state active and task_state resize_migrating.
May 14 03:46:43.708286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:43.778098 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:43.778461 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:43.834307 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:43.862350 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 binding to destination host np0000000741 is already ACTIVE {{(pid=97948) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 03:46:44.241354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:46:44.871115 np0000000741 nova-compute[97948]: DEBUG nova.compute.rpcapi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97948) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 03:46:44.879807 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:44.880443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:44.880589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:45.260063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found WWN 33000000096054cf3 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:46:45.260267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:45.260428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000096054cf3', 'path': '/dev/dm-0', 'multipath_id': '33000000096054cf3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:45.260542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000096054cf3', 'path': '/dev/dm-0', 'multipath_id': '33000000096054cf3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:46:45.770781 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:04Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:39Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:46:45.770953 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:45.771550 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:45.772192 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:45.893010 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:45.969320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:46:45.969413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:46:45.969559 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:46:46.275853 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Object Instance<6e392e3e-de9b-4cf1-801e-29301cb35483> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:46:46.277077 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] End _get_guest_xml xml=<domain type="qemu">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <uuid>6e392e3e-de9b-4cf1-801e-29301cb35483</uuid>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <name>instance-0000003a</name>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestMinimumBasicScenario-server-733319753</nova:name>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:46:41</nova:creationTime>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:image uuid="ff695fdc-7169-4a4a-a269-34745541257b">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:user uuid="8f875de7ee454dd4ad6918c6794941f1">tempest-TestMinimumBasicScenario-1441934481-project-member</nova:user>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:project uuid="6af4cde5a4934c1e8d619ec5b8c8adc9">tempest-TestMinimumBasicScenario-1441934481</nova:project>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="ff695fdc-7169-4a4a-a269-34745541257b"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         <nova:port uuid="e6e095a8-b86a-4c33-b0e8-f1149c86ea7e">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <system>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="serial">6e392e3e-de9b-4cf1-801e-29301cb35483</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="uuid">6e392e3e-de9b-4cf1-801e-29301cb35483</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </system>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <os>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </os>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <features>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </features>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   <devices>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk.config"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <alias name="ua-b80d657f-55ec-4146-ad3d-7224c7fae26a"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <serial>b80d657f-55ec-4146-ad3d-7224c7fae26a</serial>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:00:00:6e"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <target dev="tape6e095a8-b8"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </interface>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/console.log" append="off"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </serial>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <video>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </video>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </rng>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:   </devices>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]: </domain>
May 14 03:46:46.277077 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:46:46.279211 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:46.392416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:46.393136 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:46.413605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:46.472679 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:46.530306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:46.530689 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:46:46.531218 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:46.647769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:46.906399 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:46:47.034012 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Object Instance<6e392e3e-de9b-4cf1-801e-29301cb35483> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:46:47.034358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:47.081665 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:46:47.163178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44dec103d8b45e46a812f9fa074e08154cf2edab --force-share --output=json" returned: 0 in 0.129s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:47.164070 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:46:47.164208 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:47.272264 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:47.272859 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Cannot resize image /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:46:47.276659 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'migration_context' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:47.583962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:46:47.778242 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Object Instance<6e392e3e-de9b-4cf1-801e-29301cb35483> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:46:47.779174 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:04Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:39Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:46:47.779324 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:47.780049 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:47.780297 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:46:47.780679 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.781256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:47.781587 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:46:47.784665 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.784855 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbbb7b4-7ab3-5d3b-954a-b0f5f730900c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:47.786003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.786892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:47.787525 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.789488 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.789659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6e095a8-b8, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:47.790023 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6e095a8-b8, col_values=(('qos', UUID('385dcf07-af8d-4918-b6db-8f0f765ed4e5')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:47.790239 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6e095a8-b8, col_values=(('external_ids', {'iface-id': 'e6e095a8-b86a-4c33-b0e8-f1149c86ea7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:00:6e', 'vm-uuid': '6e392e3e-de9b-4cf1-801e-29301cb35483'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:47.792855 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:47.797054 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:47.798064 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8')
May 14 03:46:48.093366 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:48.106962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:46:48.137663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:48.187909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:46:48.188438 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:46:48.202786 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:46:48.202786 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:feb0:a16e'] 
May 14 03:46:48.202786 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:46:48.202786 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:46:48.203180 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:48.237520 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.262820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.362021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.553922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.559738 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.561192 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.589661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.837081 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:48.887489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:49.055990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for 6e392e3e-de9b-4cf1-801e-29301cb35483 due to new event <LifecycleEvent: 1778730409.0555544, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:46:49.056184 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730409.0555544, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:49.056301 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Resumed (Lifecycle Event)
May 14 03:46:49.057854 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:46:49.060243 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance rebooted successfully.
May 14 03:46:49.383762 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Starting finish_migration {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 03:46:49.385258 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance directory exists: not creating {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 03:46:49.385396 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Creating image(s)
May 14 03:46:49.386265 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:49.505456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:49.509581 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:46:49.509581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:49.560994 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:49.567068 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:49.613500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:49.614178 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Cannot resize image /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:46:50.069421 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 14 03:46:50.070020 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730410.0695672, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:50.070020 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Started (Lifecycle Event)
May 14 03:46:50.116849 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:46:50.117037 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Ensure instance console log exists: /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:46:50.117435 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:50.117688 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:50.117858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:50.121130 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start _get_guest_xml network_info=[{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '608384f9-6f6b-428e-a519-f1631dc5deb2', 'attached_at': '2026-05-14T03:46:48.000000', 'detached_at': '', 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'multiattach': True, 'serial': '68afeadc-26f9-4d0e-a964-e15575723cb9'}, 'boot_index': None, 'attachment_id': '2fdc86c4-f8b5-4808-8f06-03ff1d3ac479', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:46:50.123185 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:46:50.124595 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='608384f9-6f6b-428e-a519-f1631dc5deb2'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730410.1242082) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:46:50.125541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:46:50.125951 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:46:50.126872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:46:50.127050 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:46:50.128062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:46:50.128449 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:46:50.128616 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:46:50.128753 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:46:50.128909 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:46:50.129018 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:46:50.129145 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:46:50.129342 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:46:50.129469 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:46:50.129595 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:46:50.129748 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:46:50.129894 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:46:50.144359 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:50.238563 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:46:50.239154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:50.239465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:50.240195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:50.240725 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:46:50.241254 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:50.241476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:50.241919 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:50.242245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:46:50.257249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:50.258060 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:50.258573 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:50.259093 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:50.259359 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:50.261135 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:50.272299 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:50.272299 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:50.277734 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:50.277734 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:50.284205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:50.290736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.299871 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.300110 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:50.300308 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.042s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:50.300418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:50.301022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('11', '0', '0', 0) found on session 144 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:50.301135 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.307179 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:50.307419 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:50.307627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:50.307627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:50.308131 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('10', '0', '0', 0) found on session 143 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:50.308266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:50.314469 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 144 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:50.314601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:50.318456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 143 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:50.318829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:50.572935 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:50.573299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:50.573299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:46:50.573433 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No VIF found with MAC fa:16:3e:00:00:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:46:50.573856 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:50.574906 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:50.580479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:50.607864 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:50.608313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:51.083338 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f99310d-7041-4ed7-9dd8-3953e7056483 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 14.277s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:51.084602 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 14 03:46:51.112491 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:46:51.259445 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:46:52.106716 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:52.107056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:52.107056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:52.107204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:52.107358 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:52.107535 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-3c24a09d-39a0-4c3a-b4b7-0f1a45d89fbe req-d0637c49-0298-4b62-b91a-a2be9c809a05 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received unexpected event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with vm_state active and task_state None.
May 14 03:46:52.117964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:52.794623 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:53.177166 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:53.177620 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:53.177620 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Attaching volume 4fec4b60-30e1-49d5-bcb8-c66bb30b209c to /dev/vdb
May 14 03:46:53.212974 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:53.223453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:46:53.243570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:46:53.285075 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:46:53.285336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:46:53.293488 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:46:53.295662 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fe00:6e', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:feb0:a16e'] 
May 14 03:46:53.295662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:46:53.295662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:46:53.295662 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:53.295662 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating existing volume attachment record: 7bbd83ae-0b68-47ae-a9c7-276b94809610 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:46:53.839632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:53.871910 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b', 'attached_at': '', 'detached_at': '', 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'serial': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:46:53.874554 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:46:53.875003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:46:53.876365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:54.188924 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:46:54.189405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:54.189405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:54.189573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:46:54.189617 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:46:54.189983 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-6debf942-29fd-41fd-890e-c026f654e439 req-0ea04064-d628-4691-aedf-c220d4f4f729 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received unexpected event network-vif-plugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with vm_state active and task_state None.
May 14 03:46:55.701017 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00041303599982711603 future=<Future at 0x79d0b843c920 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:55.701838 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:55.701838 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.9294507680001516 future=<Future at 0x79d0b04808c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:55.701838 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.9293646099999933 future=<Future at 0x79d0b04808c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:56.631822 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00036976100000174483 future=<Future at 0x79d0b04808c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:56.631822 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:46:56.633029 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730401.631146, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:46:56.633224 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Stopped (Lifecycle Event)
May 14 03:46:56.799763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:57.142019 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:46:57.144009 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:46:57.646740 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:46:57.797661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.293108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 33000000064d1fb5e for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:46:58.293557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.052s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:58.293829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (8052ms) {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:46:58.294033 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000064d1fb5e', 'path': '/dev/dm-1', 'multipath_id': '33000000064d1fb5e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:46:58.294580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.419s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:58.294922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:46:58.308386 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:58.309179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:46:58.310412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:58.310630 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:58.311388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:46:58.312285 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:58.326109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:58.326109 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:58.331262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:46:58.331262 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:58.337995 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c] added
May 14 03:46:58.337995 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:58.337995 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:58.337995 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:58.337995 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:58.337995 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:58.337995 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:58.338389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:58.338389 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:58.338505 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:58.341798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c] added
May 14 03:46:58.341798 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:46:58.341798 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:58.341798 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:58.341798 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:46:58.341798 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:46:58.341798 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:58.341993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:46:58.342147 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:46:58.342316 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:46:58.554025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:58.554216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:58.800996 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:45:08Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:46:58.801303 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:58.802123 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:58.804585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] End _get_guest_xml xml=<domain type="qemu">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <uuid>608384f9-6f6b-428e-a519-f1631dc5deb2</uuid>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <name>instance-00000037</name>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <memory>262144</memory>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:name>multiattach-server-1</nova:name>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:46:50</nova:creationTime>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.micro" id="84">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:memory>256</nova:memory>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         <nova:port uuid="5f9133ed-acb2-4f3e-b080-6e9b9aaea794">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <system>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="serial">608384f9-6f6b-428e-a519-f1631dc5deb2</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="uuid">608384f9-6f6b-428e-a519-f1631dc5deb2</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </system>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <os>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </os>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <features>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </features>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   <devices>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk.config"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <shareable/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </disk>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:cc:f5:61"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <target dev="tap5f9133ed-ac"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </interface>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/console.log" append="off"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </serial>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <video>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </video>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </rng>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:   </devices>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]: </domain>
May 14 03:46:58.804585 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:46:58.806819 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:45:08Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000741',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:46:58.806819 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "vif_mac": "fa:16:3e:cc:f5:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:46:58.806819 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:46:58.806819 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:46:58.807048 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.807174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:58.807425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:46:58.808317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.808478 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b42557e8-8e55-53f6-ad5b-3767de18d5a6', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:58.809197 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.809867 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:58.811051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.813863 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.814043 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9133ed-ac, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:58.814387 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f9133ed-ac, col_values=(('qos', UUID('61c0053e-84b4-4907-af3e-e81715edd519')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:58.814550 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f9133ed-ac, col_values=(('external_ids', {'iface-id': '5f9133ed-acb2-4f3e-b080-6e9b9aaea794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f5:61', 'vm-uuid': '608384f9-6f6b-428e-a519-f1631dc5deb2'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:46:58.815916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.817055 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:46:58.822872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:58.824018 np0000000741 nova-compute[97948]: INFO os_vif [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac')
May 14 03:46:58.840565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:46:59.055950 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:46:59.338793 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:46:59.344259 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:59.353340 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:59.353340 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:46:59.359955 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:46:59.359955 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.364694 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.372016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.383593 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.383876 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.390326 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.390574 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:59.423181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.50.100,3260]
May 14 03:46:59.423181 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.50.100,3260] successful.
May 14 03:46:59.423181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.434273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.435033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.40.100,3260]
May 14 03:46:59.435033 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.40.100,3260] successful.
May 14 03:46:59.435033 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.448810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.453345 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.453600 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:59.453822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:59.453883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:59.454835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('15', '-', '-', 0) found on session 155 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:59.454983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.466002 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:46:59.466318 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:46:59.466507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:46:59.466578 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:46:59.468822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('16', '-', '-', 0) found on session 156 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:46:59.468822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:46:59.468822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 155 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:59.468951 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:59.482447 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 156 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:46:59.482621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:46:59.611927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:46:59.612118 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:46:59.616105 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:46:59.616255 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Claim successful on node np0000000741
May 14 03:47:00.311483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:47:00.340082 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:00.340445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:00.340445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:00.340445 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:cc:f5:61, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:00.340698 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Using config drive
May 14 03:47:00.745832 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.780941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.786586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.863920 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.899662 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.900504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:00.952007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:00.953460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:00.953460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:00.953460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:00.953460 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:00.953460 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1685e9d9-bfa5-4eae-a010-ac29113cfe4c req-9742e0ea-986f-490d-afb8-1622784c9851 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received unexpected event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with vm_state active and task_state resize_finish.
May 14 03:47:01.174209 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:01.174209 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:01.327610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found WWN 3300000002df12131 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:47:01.328300 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:01.329098 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== connect_volume: return (7453ms) {'type': 'block', 'scsi_wwn': '3300000002df12131', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000002df12131'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:01.329298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002df12131', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000002df12131'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:47:01.331595 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:47:01.332075 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:47:01.332258 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:47:01.334003 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x79d0b0743f80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b', 'attached_at': '', 'detached_at': '', 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'serial': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:47:01.334283 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.cryptsetup [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 14 03:47:01.334470 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97948) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 03:47:01.334611 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.cryptsetup [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] opening encrypted volume /dev/dm-5 {{(pid=97948) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 14 03:47:01.431048 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:01.614113 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance event wait completed in 0 seconds for  {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:01.614770 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730421.6145236, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:01.614947 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Resumed (Lifecycle Event)
May 14 03:47:01.618613 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance running successfully.
May 14 03:47:01.619999 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Failed to set time: agent not configured {{(pid=97948) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 03:47:01.620152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d3bee1eb-c23b-4da0-b2be-8c02e39cc98f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] finish_migration finished successfully. {{(pid=97948) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 03:47:01.677455 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:01.936238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Attempting to attach volume 4fec4b60-30e1-49d5-bcb8-c66bb30b209c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:47:01.937455 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:   <alias name="ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c"/>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:   <serial>4fec4b60-30e1-49d5-bcb8-c66bb30b209c</serial>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:01.937455 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:47:02.118084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:02.120306 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:02.189060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.577s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:02.189553 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:02.623020 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 03:47:02.623453 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730422.6230688, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:02.623453 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Started (Lifecycle Event)
May 14 03:47:02.694592 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:02.697014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:02.698997 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:02.699495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:02.699742 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:02.785902 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:03.034514 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:03.034734 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:03.036019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:03.036019 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:03.036019 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:03.036019 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0f0e3081-aa3e-4870-b4dd-fb8181b16e49 req-ce684842-e4c5-4e58-8342-08acc05fa541 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received unexpected event network-vif-plugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with vm_state resized and task_state None.
May 14 03:47:03.127501 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:03.131555 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:03.202932 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:03.283379 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Successfully created port: 7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:03.336782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:03.336961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:03.337091 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Going to confirm migration 4 {{(pid=97948) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 03:47:03.586479 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:03.586651 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:03.586817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:03.587140 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:b0:a1:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:03.707519 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Booting with volume snapshot 9f1687fa-f95b-4e59-b2b9-9d66f8d6d001 at /dev/vda
May 14 03:47:03.818163 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Successfully updated port: 7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:03.819334 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:03.843051 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:03.844688 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:03.869679 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-changed-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:03.869797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Refreshing instance network info cache due to event network-changed-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:03.870255 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] Acquiring lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:03.870255 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] Acquired lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:03.870255 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Refreshing network info cache for port 7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:03.941403 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:03.941853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:03.942020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:03.942194 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:03.942372 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'info_cache' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:03.997764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:03.997764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:04.323115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:04.372591 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:04.434545 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:04.500758 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:04.587192 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:04.947283 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:05.089076 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bc31fba0-bdff-465a-872c-cb60fc826c35 req-53f516dd-fc8e-4a8b-94b6-d89c915e715d service nova] Releasing lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:05.089297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:05.089424 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:05.130308 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-82f40343-c691-431a-87a0-64543f0a1dfd tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.952s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:05.208560 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:05.334570 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:05.511017 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:05.678888 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:05.837719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:05.837877 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'migration_context' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:05.848451 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:06.001058 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updating instance_info_cache with network_info: [{"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:06.243484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:06.243702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:06.339824 np0000000741 nova-compute[97948]: DEBUG nova.objects.base [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Object Instance<608384f9-6f6b-428e-a519-f1631dc5deb2> lazy-loaded attributes: info_cache,migration_context {{(pid=97948) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 03:47:06.351686 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:06.351915 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:06.503827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:06.504058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance network_info: |[{"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:06.570348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:06.570538 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:06.570757 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Attaching volume ac630e0a-c474-4344-b96e-49522982e925 to /dev/vdb
May 14 03:47:06.629567 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:06.640717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:47:06.668877 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:06.708211 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:47:06.708575 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:47:06.716831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:47:06.718151 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fe00:6e', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:feb0:a16e'] 
May 14 03:47:06.718285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:47:06.718343 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:47:06.718629 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:06.718908 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating existing volume attachment record: b085e0f6-142d-440b-a682-8c43e4c6e371 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:47:06.746884 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Detaching volume 4fec4b60-30e1-49d5-bcb8-c66bb30b209c
May 14 03:47:06.785838 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Attempting to driver detach volume 4fec4b60-30e1-49d5-bcb8-c66bb30b209c from mountpoint /dev/vdb
May 14 03:47:06.825113 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b', 'attached_at': '', 'detached_at': '', 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'serial': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:47:06.830498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:06.834992 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:06.835132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Attempting to detach device vdb from instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:47:06.835427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <alias name="ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c"/>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <serial>4fec4b60-30e1-49d5-bcb8-c66bb30b209c</serial>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:06.835427 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:06.842077 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b from the persistent domain config.
May 14 03:47:06.842283 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] (1/8): Attempting to detach device vdb with device alias ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c from instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:47:06.842516 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <alias name="ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c"/>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <serial>4fec4b60-30e1-49d5-bcb8-c66bb30b209c</serial>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:06.842516 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:07.184659 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:07.198047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:47:07.219461 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:07.269496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:47:07.270005 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:47:07.276236 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:47:07.276716 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:07.277078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:07.277815 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:07.278331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:47:07.279191 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:47:07.280888 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fe00:6e', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8', 'fe80::fc16:3eff:feb0:a16e'] 
May 14 03:47:07.281038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:47:07.281185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:47:07.281473 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:07.284169 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updating existing volume attachment record: caadb5cb-1810-45b6-bae7-4b7fb31e892a {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:47:07.293442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:07.294261 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:07.294353 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:07.296781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:07.297355 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:07.298117 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:07.316395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:07.316395 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:07.316965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:07.316965 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:07.332249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925] added
May 14 03:47:07.332249 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:07.332249 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:07.332249 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:07.332249 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:07.332249 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:07.332249 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:07.332486 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:07.332764 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:07.332927 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:07.333734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925] added
May 14 03:47:07.333734 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:07.333734 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:07.333734 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:07.333734 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:07.333734 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:07.333734 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:07.333935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:07.334094 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:07.334291 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:07.381296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730427.3808231, 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b => ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:47:07.383342 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4fec4b60-30e1-49d5-bcb8-c66bb30b209c for instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:47:07.386307 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b from the live domain config.
May 14 03:47:07.387793 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:47:07.388022 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:47:07.388161 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:47:07.388771 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x79d0b046a870>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b', 'attached_at': '', 'detached_at': '', 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'serial': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:47:07.388901 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.cryptsetup [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] closing encrypted volume /dev/dm-6 {{(pid=97948) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 14 03:47:07.411856 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:47:07.412370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:07.412505 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:07.458145 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:07.458373 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:07.963746 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:08.333335 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:08.334653 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:08.346515 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:08.346515 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:08.348726 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:08.348726 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.364016 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.366215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.390902 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.391217 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.394953 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.395294 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:08.440750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.50.100,3260]
May 14 03:47:08.440750 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.50.100,3260] successful.
May 14 03:47:08.440750 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.451537 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.40.100,3260]
May 14 03:47:08.451537 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.40.100,3260] successful.
May 14 03:47:08.451537 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.458163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.471669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.483457 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.483894 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:08.484217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:08.484217 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:08.486262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] HCTL ('19', '-', '-', 0) found on session 159 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:08.486262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.495415 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:08.496010 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:08.496010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:08.496590 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:08.499471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] HCTL ('20', '-', '-', 0) found on session 160 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:08.499471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:08.505192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching for a device in session 159 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:08.505354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:08.513260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching for a device in session 160 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:08.513260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:08.823110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:08.847385 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:08.974100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.622s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:09.297963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:47:09.397295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:09.398569 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:09.398849 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Creating image(s)
May 14 03:47:09.399251 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:47:09.399365 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Ensure instance console log exists: /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:09.399547 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:09.399890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:09.400092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:09.400668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Start _get_guest_xml network_info=[{"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-14T03:46:55Z,direct_url=<?>,disk_format='raw',id=8b9a7948-0850-4599-9ad1-8de27358316a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-367778912',owner='2f55f169d311447d9a628b9ab9e7f4a6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-14T03:46:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8e4d162e-d487-4edc-aac5-e52e0df8a125', 'attached_at': '', 'detached_at': '', 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'serial': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'}, 'boot_index': 0, 'attachment_id': 'caadb5cb-1810-45b6-bae7-4b7fb31e892a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:09.403121 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:09.404220 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-982457202', uuid='8e4d162e-d487-4edc-aac5-e52e0df8a125'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='8b9a7948-0850-4599-9ad1-8de27358316a', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730429.4039345) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:09.405424 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:09.405745 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:09.406633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:09.406819 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:09.407741 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:09.408012 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-14T03:46:55Z,direct_url=<?>,disk_format='raw',id=8b9a7948-0850-4599-9ad1-8de27358316a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-367778912',owner='2f55f169d311447d9a628b9ab9e7f4a6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-14T03:46:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:09.408139 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:09.408227 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:09.408332 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:09.408409 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:09.408501 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:09.408648 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:09.408760 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:09.408864 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:09.408952 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:09.409101 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:09.419477 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:47:09.419902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:09.420122 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:09.580816 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocation for migration e3ccf7d6-a763-4845-b5f9-ee588593ad10
May 14 03:47:10.088236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09c50a9c-9cf2-4fa4-bebf-e60ebf84eec1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.751s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:10.314224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found WWN 330000000c686020f for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:47:10.314563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:10.314836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000c686020f', 'path': '/dev/dm-6', 'multipath_id': '330000000c686020f'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:10.315062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c686020f', 'path': '/dev/dm-6', 'multipath_id': '330000000c686020f'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:47:10.316009 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.903s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:10.316352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:47:10.316524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:47:10.323526 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:10.348407 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:10.348784 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:10.348784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '160')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:47:10.349167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', '156')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:10.350029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c', '155')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:10.351143 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0459a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:47:10.351327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Removing multipathed devices sdk, sdj {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:47:10.351542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flush multipath device 3300000002df12131 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:47:10.392245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:10.439061 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:10.481007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:47:10.481193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:47:10.482406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:47:10.492992 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:47:10.493143 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:47:10.508511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.539315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.40.100,3260]
May 14 03:47:10.539315 np0000000741 nova-compute[97948]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.40.100,3260] successful.
May 14 03:47:10.539315 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.563695 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.574591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.606477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.50.100,3260]
May 14 03:47:10.606477 np0000000741 nova-compute[97948]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-4fec4b60-30e1-49d5-bcb8-c66bb30b209c, portal: 192.168.50.100,3260] successful.
May 14 03:47:10.606477 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.625598 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.626389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:10.626501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== disconnect_volume: return (3213ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:10.626609 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:47:10.628285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.208s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:10.628556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:47:10.639272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:10.640116 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:10.640532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:10.640757 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:10.641272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:10.641394 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:10.653991 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:10.653991 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.659624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:10.659624 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.666168 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b] added
May 14 03:47:10.666168 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:10.666168 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:10.666168 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:10.666168 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:10.666168 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:10.666168 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.666371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:10.666461 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:10.666584 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:10.672059 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b] added
May 14 03:47:10.672059 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:10.672059 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:10.672059 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:10.672059 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:10.672059 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:10.672059 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:10.672311 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:10.672417 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:10.672575 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:10.830030 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Attempting to attach volume ac630e0a-c474-4344-b96e-49522982e925 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:47:10.832458 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:   <alias name="ua-ac630e0a-c474-4344-b96e-49522982e925"/>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:   <serial>ac630e0a-c474-4344-b96e-49522982e925</serial>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:10.832458 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:47:11.183417 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:11.203184 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:11.206890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing instance network info cache due to event network-changed-4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:11.207061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] Acquiring lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:11.207146 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] Acquired lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:11.207268 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Refreshing network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:11.667063 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:11.673109 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:11.679918 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:11.679918 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:11.688312 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:11.688312 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.692740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.703333 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.709955 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.713740 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.714097 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.725856 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:11.774460 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.50.100,3260]
May 14 03:47:11.774460 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.50.100,3260] successful.
May 14 03:47:11.774460 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.787009 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.40.100,3260]
May 14 03:47:11.787009 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.40.100,3260] successful.
May 14 03:47:11.787009 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.794661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.798702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.814601 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.815125 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:11.815125 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:11.815525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:11.816533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('15', '-', '-', 0) found on session 161 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:11.816649 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:11.828324 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:11.828324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:11.829593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('16', '-', '-', 0) found on session 162 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:11.830142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:11.832535 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 161 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:11.832814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:11.849161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 162 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:11.849161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:12.061442 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:12.192274 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-80c749e8-7dfa-43c7-8647-ad790867fe1d tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.948s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:12.200151 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updated VIF entry in instance network info cache for port 4b5f3126-9e98-4485-b87a-b6a8cee76119. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:12.200450 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [{"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:12.480461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:12.480602 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:12.480774 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:12.480916 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No VIF found with MAC fa:16:3e:5d:fa:18, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:12.641088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:47:12.702286 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-60b57db9-cd5e-4937-afc7-6a0720ba1fc1 req-8a1a8f20-2433-430e-9dbc-d2822df72fd9 service nova] Releasing lock "refresh_cache-a2050a6c-1c7b-4454-8a7e-14960f06b79b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:12.714462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:12.714677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:12.714833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:12.714959 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:12.715052 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:12.716849 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Terminating instance
May 14 03:47:13.219630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:47:13.248443 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.260250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.268631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:13.269192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing instance network info cache due to event network-changed-5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:13.269954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] Acquiring lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:13.270203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] Acquired lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:13.270451 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Refreshing network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:13.274601 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.280543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.300852 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.306805 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.576889 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999616452999817 future=<Future at 0x79d0b01ab0b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:13.577216 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99924979699972 future=<Future at 0x79d0b01ab0b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:13.577352 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999102564999703 future=<Future at 0x79d0b01ab0b0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:13.578052 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Instance destroyed successfully.
May 14 03:47:13.578611 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'resources' on Instance uuid 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:13.660317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000e3b72f19 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:47:13.660317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:13.660317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (4240ms) {'type': 'block', 'scsi_wwn': '330000000e3b72f19', 'path': '/dev/dm-5', 'multipath_id': '330000000e3b72f19'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:13.660317 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3b72f19', 'path': '/dev/dm-5', 'multipath_id': '330000000e3b72f19'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:47:13.773409 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:13.824086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:13.850501 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.055154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-217428fd-634e-4757-bf9b-bd618ddf31cc tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.485s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:14.080871 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:14.083260 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1362708422',display_name='tempest-TestEncryptedCinderVolumes-server-1362708422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1362708422',id=60,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA43NCjuLfRMus0VQddn43CUF52bslIhCNvSt4jg+STmgrnnpDh8H1cF9+Dbiem8vo1C6UYZDtNgWM180Gy5hbGp5Qee2/7XEKIHn6s6RR6Aw8JM6u2hamnXjoIz3Xt8jw==',key_name='tempest-keypair-177846303',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:12Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-kcexsyk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:47:14.086111 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4936f21d-1236-469d-9dab-b5b584f81e0e", "address": "fa:16:3e:b0:a1:6e", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4936f21d-12", "ovs_interfaceid": "4936f21d-1236-469d-9dab-b5b584f81e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:14.086732 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:14.086906 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:47:14.088259 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.088580 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4936f21d-12, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.090048 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.091059 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:14.094917 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.095953 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.096109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38d80b95-e2f2-44c2-a060-29af69204d99) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.096570 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.097109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:14.097779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.099549 np0000000741 nova-compute[97948]: INFO os_vif [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:a1:6e,bridge_name='br-int',has_traffic_filtering=True,id=4936f21d-1236-469d-9dab-b5b584f81e0e,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4936f21d-12')
May 14 03:47:14.100079 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Deleting instance files /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b_del
May 14 03:47:14.100765 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Deletion of /opt/stack/data/nova/instances/6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b_del complete
May 14 03:47:14.167501 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-image-snapshot-server-982457202',id=62,image_ref='8b9a7948-0850-4599-9ad1-8de27358316a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOnBXAjZWxuE/vvqK2PKYUxujAs/Hicf/LPi5QJtJEFJpMjjREah5YCwOQxMazHsuztRZjud/pPf/u+SYEwLwl9N8Kh95MOzonAw8mdY0e4lyr4EyZrz1rsQjb3aN5WAA==',key_name='tempest-keypair-1227955810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-mb1p5ob3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1781728370',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=8e4d162e-d487-4edc-aac5-e52e0df8a125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:14.167501 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:14.167501 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:14.167501 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e4d162e-d487-4edc-aac5-e52e0df8a125 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:14.202246 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updated VIF entry in instance network info cache for port 5f9133ed-acb2-4f3e-b080-6e9b9aaea794. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:14.202462 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [{"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:14.606180 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:47:14.606819 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:47:14.607122 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:47:14.607213 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:47:14.607421 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:14.669520 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <uuid>8e4d162e-d487-4edc-aac5-e52e0df8a125</uuid>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <name>instance-0000003e</name>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-982457202</nova:name>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:09</nova:creationTime>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:diskFormat>raw</nova:diskFormat>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="img_bdm_v2">True</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid=""/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         <nova:port uuid="7dd1ed39-95a8-4d02-838b-d9b0aa58c11c">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="serial">8e4d162e-d487-4edc-aac5-e52e0df8a125</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="uuid">8e4d162e-d487-4edc-aac5-e52e0df8a125</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/disk.config"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <alias name="ua-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-5"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <serial>aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b</serial>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:08:45:ee"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <target dev="tap7dd1ed39-95"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/console.log" append="off"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:14.669520 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Preparing to wait for external event network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-image-snapshot-server-982457202',id=62,image_ref='8b9a7948-0850-4599-9ad1-8de27358316a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOnBXAjZWxuE/vvqK2PKYUxujAs/Hicf/LPi5QJtJEFJpMjjREah5YCwOQxMazHsuztRZjud/pPf/u+SYEwLwl9N8Kh95MOzonAw8mdY0e4lyr4EyZrz1rsQjb3aN5WAA==',key_name='tempest-keypair-1227955810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-mb1p5ob3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1781728370',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=8e4d162e-d487-4edc-aac5-e52e0df8a125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.674798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33775a5f-25d1-596a-85b1-ee6ee4d66354', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.678368 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:14.687599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.689823 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:14.691730 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.691847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dd1ed39-95, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.692174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dd1ed39-95, col_values=(('qos', UUID('48a8690f-6b52-4f2b-b1c4-e60b58e2f1dd')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.693109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dd1ed39-95, col_values=(('external_ids', {'iface-id': '7dd1ed39-95a8-4d02-838b-d9b0aa58c11c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:45:ee', 'vm-uuid': '8e4d162e-d487-4edc-aac5-e52e0df8a125'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:14.693326 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.694429 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:14.699510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:14.700694 np0000000741 nova-compute[97948]: INFO os_vif [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95')
May 14 03:47:14.704174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a683bef-67f7-44a8-ab89-f570edbcedc8 req-c518618f-01a6-43d2-98bc-d499e14ddf5f service nova] Releasing lock "refresh_cache-608384f9-6f6b-428e-a519-f1631dc5deb2" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:15.339549 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:15.342403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:15.342729 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:15.343082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:15.343333 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] No waiting events found dispatching network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:15.343595 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:15.343903 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:15.344197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Acquiring lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:15.344452 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:15.344718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:15.345042 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] No waiting events found dispatching network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:15.345364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-unplugged-4936f21d-1236-469d-9dab-b5b584f81e0e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:15.345630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Received event network-vif-deleted-4936f21d-1236-469d-9dab-b5b584f81e0e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:15.345925 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Neutron deleted interface 4936f21d-1236-469d-9dab-b5b584f81e0e; detaching it from the instance and deleting it from the info cache
May 14 03:47:15.346171 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:15.667143 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:15.855188 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ee9b93d2-dd99-4f1a-8543-3f93f4648b29 req-2562de13-7126-4093-ae70-292aeb57516b service nova] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Detach interface failed, port_id=4936f21d-1236-469d-9dab-b5b584f81e0e, reason: Instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:47:16.169165 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Took 1.56 seconds to deallocate network for instance.
May 14 03:47:16.225503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:16.225678 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:16.225796 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:08:45:ee, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:16.226605 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Using config drive
May 14 03:47:16.681824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:16.681824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:16.685068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:16.685269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:16.731276 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:16.880191 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Creating config drive at /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/disk.config
May 14 03:47:16.884041 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ctm1g7p {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:16.940770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ctm1g7p" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:17.019233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:17.019712 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:17.187951 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Detaching volume b80d657f-55ec-4146-ad3d-7224c7fae26a
May 14 03:47:17.233794 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Attempting to driver detach volume b80d657f-55ec-4146-ad3d-7224c7fae26a from mountpoint /dev/vdb
May 14 03:47:17.245541 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found disk vdb by alias ua-b80d657f-55ec-4146-ad3d-7224c7fae26a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:17.248932 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found disk vdb by alias ua-b80d657f-55ec-4146-ad3d-7224c7fae26a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:17.249036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Attempting to detach device vdb from instance 6e392e3e-de9b-4cf1-801e-29301cb35483 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:47:17.249283 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <alias name="ua-b80d657f-55ec-4146-ad3d-7224c7fae26a"/>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <serial>b80d657f-55ec-4146-ad3d-7224c7fae26a</serial>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:17.249283 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:17.255433 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully detached device vdb from instance 6e392e3e-de9b-4cf1-801e-29301cb35483 from the persistent domain config.
May 14 03:47:17.255632 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] (1/8): Attempting to detach device vdb with device alias ua-b80d657f-55ec-4146-ad3d-7224c7fae26a from instance 6e392e3e-de9b-4cf1-801e-29301cb35483 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:47:17.256001 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <alias name="ua-b80d657f-55ec-4146-ad3d-7224c7fae26a"/>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <serial>b80d657f-55ec-4146-ad3d-7224c7fae26a</serial>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:17.256001 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:17.282829 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:17.283024 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:17.396168 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.418240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.423761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.442102 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:17.442317 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing instance network info cache due to event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:17.442477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:17.442767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:17.443064 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:17.514870 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.521900 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:47:17.525439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.526270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:17.577229 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5a0728f-e0e2-4d51-839d-dce4d8e43d13 req-71a91683-b0b9-4d40-98bb-bb5ca5f4850b service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:17.577573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a0728f-e0e2-4d51-839d-dce4d8e43d13 req-71a91683-b0b9-4d40-98bb-bb5ca5f4850b service nova] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:17.578171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a0728f-e0e2-4d51-839d-dce4d8e43d13 req-71a91683-b0b9-4d40-98bb-bb5ca5f4850b service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:17.578287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a0728f-e0e2-4d51-839d-dce4d8e43d13 req-71a91683-b0b9-4d40-98bb-bb5ca5f4850b service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:17.578409 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5a0728f-e0e2-4d51-839d-dce4d8e43d13 req-71a91683-b0b9-4d40-98bb-bb5ca5f4850b service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Processing event network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:17.753248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730437.7528782, 6e392e3e-de9b-4cf1-801e-29301cb35483 => ua-b80d657f-55ec-4146-ad3d-7224c7fae26a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:47:17.754367 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b80d657f-55ec-4146-ad3d-7224c7fae26a for instance 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:47:17.756622 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully detached device vdb from instance 6e392e3e-de9b-4cf1-801e-29301cb35483 from the live domain config.
May 14 03:47:17.757776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:47:17.758249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:17.758435 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:17.758906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:17.759294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80d657f-55ec-4146-ad3d-7224c7fae26a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:47:17.759523 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:47:17.785809 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:17.790806 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:17.791177 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '162')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:47:17.791177 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '153')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:17.792396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a', '154')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:17.793268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0220900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:47:17.793481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:47:17.793758 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flush multipath device 33000000096054cf3 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:47:17.837712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:17.878939 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:17.919987 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:47:17.920109 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:47:17.921545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:47:17.931729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:47:17.931968 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:47:17.941904 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:17.945130 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:17.970501 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:17.970686 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:17.984238 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260]
May 14 03:47:17.984238 np0000000741 nova-compute[97948]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.40.100,3260] successful.
May 14 03:47:17.984238 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:18.009167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:18.023135 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:18.065128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260]
May 14 03:47:18.065128 np0000000741 nova-compute[97948]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-b80d657f-55ec-4146-ad3d-7224c7fae26a, portal: 192.168.50.100,3260] successful.
May 14 03:47:18.065128 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:18.074410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:18.088817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:18.088817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:18.088817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== disconnect_volume: return (326ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:18.088817 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:47:18.141446 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730438.141109, 8e4d162e-d487-4edc-aac5-e52e0df8a125 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:18.142041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:18.142308 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] VM Started (Lifecycle Event)
May 14 03:47:18.144816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:18.151388 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance spawned successfully.
May 14 03:47:18.151735 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:18.156333 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:18.156793 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:18.228242 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:18.292371 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.611s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:18.293754 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.219s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:18.296957 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:47:18.297084 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Claim successful on node np0000000741
May 14 03:47:18.350346 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deleted allocations for instance 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b
May 14 03:47:18.361029 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updated VIF entry in instance network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:18.361238 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:18.473974 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Detaching volume ac630e0a-c474-4344-b96e-49522982e925
May 14 03:47:18.517628 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Attempting to driver detach volume ac630e0a-c474-4344-b96e-49522982e925 from mountpoint /dev/vdb
May 14 03:47:18.524249 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found disk vdb by alias ua-ac630e0a-c474-4344-b96e-49522982e925 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:18.528272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found disk vdb by alias ua-ac630e0a-c474-4344-b96e-49522982e925 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:18.528413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Attempting to detach device vdb from instance 39304f73-2e21-43f5-a634-2e1f42124be5 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:47:18.528695 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <alias name="ua-ac630e0a-c474-4344-b96e-49522982e925"/>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <serial>ac630e0a-c474-4344-b96e-49522982e925</serial>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:18.528695 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:18.534547 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully detached device vdb from instance 39304f73-2e21-43f5-a634-2e1f42124be5 from the persistent domain config.
May 14 03:47:18.534630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] (1/8): Attempting to detach device vdb with device alias ua-ac630e0a-c474-4344-b96e-49522982e925 from instance 39304f73-2e21-43f5-a634-2e1f42124be5 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:47:18.534897 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <alias name="ua-ac630e0a-c474-4344-b96e-49522982e925"/>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-6"/>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <serial>ac630e0a-c474-4344-b96e-49522982e925</serial>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:18.534897 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:18.632587 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:18.650537 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:18.652943 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:18.661090 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Took 9.26 seconds to spawn the instance on the hypervisor.
May 14 03:47:18.661090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:18.850374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:18.863060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:18.863207 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:18.863339 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing instance network info cache due to event network-changed-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:18.863532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Acquiring lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:18.863671 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Acquired lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:18.863671 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Refreshing network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:19.017245 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ac630e0a-c474-4344-b96e-49522982e925 for instance 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:47:19.155456 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:47:19.155684 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730439.1554706, 8e4d162e-d487-4edc-aac5-e52e0df8a125 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:19.155803 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] VM Paused (Lifecycle Event)
May 14 03:47:19.169620 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Took 19.61 seconds to build instance.
May 14 03:47:19.358042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a5ce60cc-5cd1-44fe-85d6-245ce1586eff tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.643s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:19.365510 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:19.637322 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-bd7d0f9f-ade2-4d90-8296-b91c09581f21 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.952s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:19.661250 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] No waiting events found dispatching network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:19.664054 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-4d94807a-b121-4df4-a3aa-d93fe2fd699a req-5e0f7b49-6c28-415f-90c6-23e848fb5a47 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received unexpected event network-vif-plugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c for instance with vm_state active and task_state None.
May 14 03:47:19.665736 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730439.6654997, 8e4d162e-d487-4edc-aac5-e52e0df8a125 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:19.665855 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] VM Resumed (Lifecycle Event)
May 14 03:47:19.671014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d5339e35-d266-4207-bfe4-8c3848389bc8 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.117s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:19.702240 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:19.783237 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:19.908757 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:19.909252 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:19.944040 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updated VIF entry in instance network info cache for port e6e095a8-b86a-4c33-b0e8-f1149c86ea7e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:19.944237 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [{"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:19.996815 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-changed-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:19.997215 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Refreshing instance network info cache due to event network-changed-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:19.997359 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] Acquiring lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:19.997443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] Acquired lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:19.997555 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Refreshing network info cache for port 7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:20.168651 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:20.171463 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:20.411197 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:20.446207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-17505269-5e92-450a-9785-dabff308ee17 req-890eabad-aece-48cc-96c8-9d58d5d2866d service nova] Releasing lock "refresh_cache-6e392e3e-de9b-4cf1-801e-29301cb35483" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:20.501521 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:20.673216 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730440.672516, 39304f73-2e21-43f5-a634-2e1f42124be5 => ua-ac630e0a-c474-4344-b96e-49522982e925> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:47:20.675587 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully detached device vdb from instance 39304f73-2e21-43f5-a634-2e1f42124be5 from the live domain config.
May 14 03:47:20.677029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:47:20.677266 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:20.677401 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:20.677776 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:20.678008 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac630e0a-c474-4344-b96e-49522982e925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:47:20.678138 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:20.706580 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925 (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:20.706896 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:20.706896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '162')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:47:20.707198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '160')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:20.708004 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925', '159')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:20.708788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c6fc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'): ({'sdn'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:47:20.708944 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Removing multipathed devices sdn, sdo {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:47:20.709145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flush multipath device 330000000c686020f {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:47:20.744171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:20.788185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:20.817238 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:20.837298 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:47:20.837472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:47:20.838660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:47:20.849192 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:47:20.849353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:47:20.862960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:20.903312 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.40.100,3260]
May 14 03:47:20.903312 np0000000741 nova-compute[97948]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.40.100,3260] successful.
May 14 03:47:20.903312 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:20.917050 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.624s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:20.917452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:20.933518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:20.948195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:20.956770 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updated VIF entry in instance network info cache for port 7dd1ed39-95a8-4d02-838b-d9b0aa58c11c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:20.957030 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updating instance_info_cache with network_info: [{"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:20.991734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.50.100,3260]
May 14 03:47:20.991734 np0000000741 nova-compute[97948]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-ac630e0a-c474-4344-b96e-49522982e925, portal: 192.168.50.100,3260] successful.
May 14 03:47:20.991734 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:21.012962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:21.013204 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:21.013353 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== disconnect_volume: return (335ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:21.013482 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:47:21.072145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:21.072351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:21.072533 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:21.072733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:21.072926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:21.075883 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Terminating instance
May 14 03:47:21.426786 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:21.426964 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:21.427224 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:21.428204 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:21.459243 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2cf5a697-44f3-4333-be9c-757231dd80ee req-30313398-d05b-4728-90f6-445a24f5506e service nova] Releasing lock "refresh_cache-8e4d162e-d487-4edc-aac5-e52e0df8a125" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:21.505610 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ce7f78f81b4fe780ebc7a1d615a0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb53bd4f2841db99df994d7e6c2a72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:21.578277 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:21.582179 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:47:21.602238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.602964 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.621711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.624648 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.643581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.653024 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:21.783422 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:21.784208 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:21.915728 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999721997000051 future=<Future at 0x79d0b81a0f20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:21.919590 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Instance destroyed successfully.
May 14 03:47:21.920116 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'resources' on Instance uuid 6e392e3e-de9b-4cf1-801e-29301cb35483 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:21.928400 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:22.101794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c29c32c-6106-427c-b029-375a771488d7 req-7b1d0fb7-2611-493f-ae7f-29957380a361 service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:22.211096 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Successfully created port: 093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:22.422757 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-733319753',display_name='tempest-TestMinimumBasicScenario-server-733319753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-733319753',id=58,image_ref='ff695fdc-7169-4a4a-a269-34745541257b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeccWAcFGrbykTpR0XygzPCXw4VSFoG4w5uTYHsopMPsB7/QpzD91iznqTo5qgNJBQL1wAuppVCnyrvWbCrqwo34Wa33U4uUNZ07gYr9N8A6QqzDygI4HtgM8o9nx9Dg==',key_name='tempest-TestMinimumBasicScenario-1252339367',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:04Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-i82vtfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ff695fdc-7169-4a4a-a269-34745541257b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:51Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=6e392e3e-de9b-4cf1-801e-29301cb35483,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:47:22.422953 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "address": "fa:16:3e:00:00:6e", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e095a8-b8", "ovs_interfaceid": "e6e095a8-b86a-4c33-b0e8-f1149c86ea7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:22.423670 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:22.423956 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:47:22.425569 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:22.425834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6e095a8-b8, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:22.426794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:22.428465 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:22.429317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:22.429888 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=385dcf07-af8d-4918-b6db-8f0f765ed4e5) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:22.431856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:22.431856 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:22.434809 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:22.436845 np0000000741 nova-compute[97948]: INFO os_vif [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:00:6e,bridge_name='br-int',has_traffic_filtering=True,id=e6e095a8-b86a-4c33-b0e8-f1149c86ea7e,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e095a8-b8')
May 14 03:47:22.437151 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Deleting instance files /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483_del
May 14 03:47:22.437891 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Deletion of /opt/stack/data/nova/instances/6e392e3e-de9b-4cf1-801e-29301cb35483_del complete
May 14 03:47:22.584716 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-d9d57843-79aa-4493-9d53-141b6f01ba32 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.614s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:22.698562 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Successfully updated port: 093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:22.752468 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-changed-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:22.752619 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Refreshing instance network info cache due to event network-changed-093527f6-49e0-45f0-b1c6-d36d937e7d5d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:22.752826 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] Acquiring lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:22.752995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] Acquired lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:22.752995 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Refreshing network info cache for port 093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:22.943390 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:47:22.943949 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:47:22.944098 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:47:22.944204 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:47:22.944421 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:23.066162 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:23.201206 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:23.263977 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:23.320824 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:23.441522 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:23.442442 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:23.442728 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Creating image(s)
May 14 03:47:23.443178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:23.443336 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:23.443951 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:23.444558 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:23.446905 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:23.447905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:23.465423 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:23.536467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:23.536931 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:23.537368 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:23.537856 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:23.541166 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:23.541814 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:23.589477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:23.589744 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:23.632227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:23.632571 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:23.682271 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk 1073741824" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:23.682859 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:23.683169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:23.769351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:23.769351 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:47:23.769498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:23.784424 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:23.852265 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:23.861981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:23.861981 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Cannot resize image /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:47:23.861981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:47:23.861981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Ensure instance console log exists: /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:23.862313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:23.862408 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:23.862541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:23.969578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-90b87b00-5ce0-48d0-b545-402ea9caab07 req-e35cc3ee-155e-4bea-9d2a-5ab18fbebb58 service nova] Releasing lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:23.970078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquired lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:23.970279 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:24.094729 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:47:24.160334 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:24.160568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] Acquiring lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:24.163758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:24.163758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:24.163758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] No waiting events found dispatching network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:24.163758 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d72df24-baf9-4565-a001-dfe028194c18 req-aa93d8d7-3e68-4496-ad28-bf270327b7ab service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-unplugged-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:24.288720 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Took 1.34 seconds to deallocate network for instance.
May 14 03:47:24.552721 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:24.651658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:24.651658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:24.654471 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:47:24.654779 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Claim successful on node np0000000741
May 14 03:47:24.716662 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:24.783994 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:24.787190 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:24.795731 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:24.819049 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-82ea49af-32b0-4a80-b2f8-ceb7991751d7 req-110d9718-2291-4373-9a2f-fe04c7e0376c service nova] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Received event network-vif-deleted-e6e095a8-b86a-4c33-b0e8-f1149c86ea7e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:24.840409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating instance_info_cache with network_info: [{"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:25.342423 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Releasing lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:25.342909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance network_info: |[{"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:25.344221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Start _get_guest_xml network_info=[{"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:25.346549 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:25.347596 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-37528970', uuid='203f4e13-7bd5-4060-92d1-37674b547f4a'), owner=OwnerMeta(userid='05ce7f78f81b4fe780ebc7a1d615a0ec', username='tempest-TestEncryptedCinderVolumes-2068807358-project-member', projectid='71fb53bd4f2841db99df994d7e6c2a72', projectname='tempest-TestEncryptedCinderVolumes-2068807358'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730445.3472903) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:25.348660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:25.348969 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:25.349851 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:25.350020 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:25.350850 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:25.351118 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:25.351275 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:25.351335 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:25.351432 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:25.351520 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:25.351613 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:25.351772 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:25.351876 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:25.351999 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:25.352088 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:25.352194 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:25.362697 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-37528970',display_name='tempest-TestEncryptedCinderVolumes-server-37528970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-37528970',id=63,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJkWLoBNj/3MZEFWkaOllptqAI+iuXQ6MEJFhysjenLvuFm7NQ9x7ZQbENYc652IIc89Lp7Th9ucRxZYDpVPz3ZTtfatzb61kO1qUwIxHECsDq9suqpMl2BAB6X0rY2Gw==',key_name='tempest-keypair-479848232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-0oc17s5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=203f4e13-7bd5-4060-92d1-37674b547f4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:25.362841 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:25.363379 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:25.364037 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'pci_devices' on Instance uuid 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:25.423091 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:25.866597 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <uuid>203f4e13-7bd5-4060-92d1-37674b547f4a</uuid>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <name>instance-0000003f</name>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-37528970</nova:name>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:25</nova:creationTime>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:user uuid="05ce7f78f81b4fe780ebc7a1d615a0ec">tempest-TestEncryptedCinderVolumes-2068807358-project-member</nova:user>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:project uuid="71fb53bd4f2841db99df994d7e6c2a72">tempest-TestEncryptedCinderVolumes-2068807358</nova:project>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         <nova:port uuid="093527f6-49e0-45f0-b1c6-d36d937e7d5d">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="serial">203f4e13-7bd5-4060-92d1-37674b547f4a</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="uuid">203f4e13-7bd5-4060-92d1-37674b547f4a</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.config"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:9a:3c:ec"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <target dev="tap093527f6-49"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/console.log" append="off"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:25.866597 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Preparing to wait for external event network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-37528970',display_name='tempest-TestEncryptedCinderVolumes-server-37528970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-37528970',id=63,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJkWLoBNj/3MZEFWkaOllptqAI+iuXQ6MEJFhysjenLvuFm7NQ9x7ZQbENYc652IIc89Lp7Th9ucRxZYDpVPz3ZTtfatzb61kO1qUwIxHECsDq9suqpMl2BAB6X0rY2Gw==',key_name='tempest-keypair-479848232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-0oc17s5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=203f4e13-7bd5-4060-92d1-37674b547f4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.871213 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '566560da-7dbf-59aa-8588-a3722cd65c3b', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:25.872970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.872970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:25.873274 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.875206 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.875292 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap093527f6-49, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:25.875608 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap093527f6-49, col_values=(('qos', UUID('e46b0c69-1ee2-4d17-9c0e-6a3137d9b8d0')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:25.875791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap093527f6-49, col_values=(('external_ids', {'iface-id': '093527f6-49e0-45f0-b1c6-d36d937e7d5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:3c:ec', 'vm-uuid': '203f4e13-7bd5-4060-92d1-37674b547f4a'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:25.876485 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.877824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:25.883056 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:25.884659 np0000000741 nova-compute[97948]: INFO os_vif [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49')
May 14 03:47:25.928185 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] instance snapshotting
May 14 03:47:26.077000 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Beginning live snapshot process
May 14 03:47:26.236975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:26.237181 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:26.739883 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:27.246464 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.596s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:27.246857 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:27.249007 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.453s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:27.399655 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:27.399794 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:27.399894 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No VIF found with MAC fa:16:3e:9a:3c:ec, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:27.400278 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Using config drive
May 14 03:47:27.590740 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:27.694860 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:27.697085 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json -f qcow2 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:27.759759 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:27.759759 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:27.759759 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:27.762281 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:27.783280 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:27.783692 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:27.792076 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.095s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:27.795780 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:27.795780 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:27.796142 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:27.849705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:27.849973 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:27.865107 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '547494feb9d9440690768b7350f15860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43df7b9472f445dfbf816cb9b648332e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:27.893879 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:27.894958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d.delta 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:27.922470 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:27.956187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d.delta 1073741824" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:27.958510 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 03:47:28.075787 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Creating config drive at /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.config
May 14 03:47:28.079525 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqfytru4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:28.131556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqfytru4" returned: 0 in 0.051s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:28.201665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:47:28.263020 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:28.353692 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:28.407187 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Successfully created port: 6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:28.577282 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007055610003590118 future=<Future at 0x79d0b01ab0b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:28.577346 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:28.577847 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.337940934000017 future=<Future at 0x79d0b81a0f20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:28.577847 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.33780981200016 future=<Future at 0x79d0b81a0f20 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:28.578205 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730433.576373, 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:28.579723 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] VM Stopped (Lifecycle Event)
May 14 03:47:28.635787 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:28.661592 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:28.705388 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=97948) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 03:47:28.707880 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 03:47:28.762381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:28.768739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:28.783940 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:28.784063 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:47:28.784697 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:28.799103 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:47:28.799518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d.delta /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:28.856252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:28.869233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.620s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:28.893380 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2c41d6ee-38df-4e77-b135-88fc45c682bc req-37286200-bba5-4683-a553-beeb6ceaa6d4 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:28.893990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c41d6ee-38df-4e77-b135-88fc45c682bc req-37286200-bba5-4683-a553-beeb6ceaa6d4 service nova] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:28.894229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c41d6ee-38df-4e77-b135-88fc45c682bc req-37286200-bba5-4683-a553-beeb6ceaa6d4 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:28.894447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c41d6ee-38df-4e77-b135-88fc45c682bc req-37286200-bba5-4683-a553-beeb6ceaa6d4 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:28.894618 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2c41d6ee-38df-4e77-b135-88fc45c682bc req-37286200-bba5-4683-a553-beeb6ceaa6d4 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Processing event network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:28.947068 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Deleted allocations for instance 6e392e3e-de9b-4cf1-801e-29301cb35483
May 14 03:47:28.968773 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Successfully updated port: 6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:29.007761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:29.009300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:29.010919 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:29.030333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:29.031698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-changed-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:29.033281 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Refreshing instance network info cache due to event network-changed-6514bca4-f763-4523-8c91-0dc665bac7eb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:29.033484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] Acquiring lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:29.033746 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] Acquired lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:29.034020 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Refreshing network info cache for port 6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:29.084459 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d.delta /opt/stack/data/nova/instances/snapshots/tmpohcda4bs/6cd6abd8533c427983ed553d3d46f98d" returned: 0 in 0.285s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:29.085676 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6770eb2e-b5f3-4ef6-91fb-ec01273b8a8b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:29.089142 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Snapshot extracted, beginning image upload
May 14 03:47:29.456469 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:29.459181 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730449.458786, 203f4e13-7bd5-4060-92d1-37674b547f4a => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:29.459312 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] VM Started (Lifecycle Event)
May 14 03:47:29.470575 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:29.473519 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:29.474414 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance spawned successfully.
May 14 03:47:29.474827 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:29.536408 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:29.597280 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:29.751208 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:29.778734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:29.780074 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:29.780316 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Creating image(s)
May 14 03:47:29.780809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:29.780986 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:29.782512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:29.782512 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:29.785213 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:29.785702 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:29.789326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:29.883695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:29.884600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:29.884866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:29.885495 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:29.890288 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:29.890771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:29.962721 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:29.964651 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-cf3ecea7-f0ce-48e8-8445-fb96a89e0496 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "6e392e3e-de9b-4cf1-801e-29301cb35483" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.892s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:29.972759 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:29.986939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.987267 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.987694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.987972 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.988822 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.988822 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:29.993858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:29.996628 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:30.063286 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk 1073741824" returned: 0 in 0.066s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:30.063776 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:30.064090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:30.161433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:30.161752 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:47:30.161970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:30.253851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-66c2453e-1a48-4974-ab43-1b7877d874c2 req-37e6ab05-17cf-4706-bb58-894e39ceb10d service nova] Releasing lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:30.254470 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquired lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:30.254805 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:30.254990 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:30.256311 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Cannot resize image /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:47:30.257300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:47:30.257300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Ensure instance console log exists: /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:30.257300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:30.257466 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:30.257674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:30.309467 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:30.309991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:30.310132 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:30.310265 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:47:30.477787 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:47:30.478258 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730450.4779227, 203f4e13-7bd5-4060-92d1-37674b547f4a => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:30.478322 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] VM Paused (Lifecycle Event)
May 14 03:47:30.494076 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Took 7.05 seconds to spawn the instance on the hypervisor.
May 14 03:47:30.494622 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:30.854252 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:30.879982 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:30.971567 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:30.971813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:30.971982 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:30.974704 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:30.975361 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] No waiting events found dispatching network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:30.975444 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d9d08817-f75b-437c-854d-d365ef59ffb9 req-98a0207d-2187-4681-a9ec-ac1fc9a48e90 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received unexpected event network-vif-plugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d for instance with vm_state active and task_state None.
May 14 03:47:30.982228 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:30.984582 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730450.9843125, 203f4e13-7bd5-4060-92d1-37674b547f4a => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:30.984768 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] VM Resumed (Lifecycle Event)
May 14 03:47:31.005991 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Took 12.98 seconds to build instance.
May 14 03:47:31.078511 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:31.258497 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updating instance_info_cache with network_info: [{"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:31.353597 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.427419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:31.427419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:31.469767 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:31.470032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.490260 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:31.498734 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:31.508064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.488s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:31.572191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:31.574965 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:47:31.578653 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.688100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:31.689516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.762962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Releasing lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:31.763583 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance network_info: |[{"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:31.769416 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Start _get_guest_xml network_info=[{"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:31.772650 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:31.774573 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1898993263', uuid='8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6'), owner=OwnerMeta(userid='547494feb9d9440690768b7350f15860', username='tempest-TestEncryptedCinderVolumes-402629128-project-member', projectid='43df7b9472f445dfbf816cb9b648332e', projectname='tempest-TestEncryptedCinderVolumes-402629128'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730451.7740347) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:31.777576 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:31.778073 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:31.779650 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:31.779908 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:31.781327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:31.781852 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:31.782074 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:31.782220 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:31.782429 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:31.782568 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:31.784264 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:31.784453 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:31.784622 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:31.784816 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:31.784986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:31.785139 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:31.821169 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:31.821563 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:47:31.827183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1898993263',display_name='tempest-TestEncryptedCinderVolumes-server-1898993263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1898993263',id=64,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXRUeu9bClYl1krF2P7CLvpC+DYYJmR/Ovyhmv43GOLnCr/iqVXtH9/GPqLKFFtQzXQVTQn7gpVOmoOCtJ9VWv3PZt0Ohd4fFF7dgdCMhEeMHMA/Z8JNMoLtfo5Ka/q0w==',key_name='tempest-keypair-1522213741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-dlsx8ygy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:31.829778 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:31.830205 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:31.836251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.837070 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'pci_devices' on Instance uuid 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:31.858666 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Snapshot image upload complete
May 14 03:47:31.859173 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-bece7b02-9ea0-4cb7-b59c-4e3bd9202b5a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Took 5.93 seconds to snapshot the instance on the hypervisor.
May 14 03:47:31.933388 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Detaching volume 68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:47:31.968773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:31.969233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:31.999452 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Attempting to driver detach volume 68afeadc-26f9-4d0e-a964-e15575723cb9 from mountpoint /dev/vdb
May 14 03:47:32.010384 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:32.014028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:32.014028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Attempting to detach device vdb from instance a2050a6c-1c7b-4454-8a7e-14960f06b79b from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:47:32.014028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:32.014028 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:32.023179 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance a2050a6c-1c7b-4454-8a7e-14960f06b79b from the persistent domain config.
May 14 03:47:32.023354 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] (1/8): Attempting to detach device vdb with device alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 from instance a2050a6c-1c7b-4454-8a7e-14960f06b79b from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:47:32.023921 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:32.023921 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:32.078223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.081679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.179447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.179975 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.285174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.293529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:47:32.298573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.360490 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <uuid>8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6</uuid>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <name>instance-00000040</name>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1898993263</nova:name>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:31</nova:creationTime>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:user uuid="547494feb9d9440690768b7350f15860">tempest-TestEncryptedCinderVolumes-402629128-project-member</nova:user>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:project uuid="43df7b9472f445dfbf816cb9b648332e">tempest-TestEncryptedCinderVolumes-402629128</nova:project>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         <nova:port uuid="6514bca4-f763-4523-8c91-0dc665bac7eb">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="serial">8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="uuid">8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.config"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:f7:9d:a2"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <target dev="tap6514bca4-f7"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/console.log" append="off"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:32.360490 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Preparing to wait for external event network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1898993263',display_name='tempest-TestEncryptedCinderVolumes-server-1898993263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1898993263',id=64,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXRUeu9bClYl1krF2P7CLvpC+DYYJmR/Ovyhmv43GOLnCr/iqVXtH9/GPqLKFFtQzXQVTQn7gpVOmoOCtJ9VWv3PZt0Ohd4fFF7dgdCMhEeMHMA/Z8JNMoLtfo5Ka/q0w==',key_name='tempest-keypair-1522213741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-dlsx8ygy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:32.362974 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:32.365677 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:32.365677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.365677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:32.365677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:32.368558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.368765 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a034154-7915-5865-bb14-4b76baa8445a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:32.370865 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.371610 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:32.374374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.376629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.376900 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6514bca4-f7, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:32.379581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6514bca4-f7, col_values=(('qos', UUID('6773969c-24f2-48c3-8067-dc9351689a4f')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:32.380567 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6514bca4-f7, col_values=(('external_ids', {'iface-id': '6514bca4-f763-4523-8c91-0dc665bac7eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:9d:a2', 'vm-uuid': '8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:32.382729 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.383782 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:32.388702 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:32.389866 np0000000741 nova-compute[97948]: INFO os_vif [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7')
May 14 03:47:32.415661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.415661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.523855 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.526660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:47:32.528612 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.633136 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730452.6322157, a2050a6c-1c7b-4454-8a7e-14960f06b79b => ua-68afeadc-26f9-4d0e-a964-e15575723cb9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:47:32.635738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.636673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.651534 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 for instance a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:47:32.655792 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance a2050a6c-1c7b-4454-8a7e-14960f06b79b from the live domain config.
May 14 03:47:32.735109 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.738702 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:47:32.741097 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:32.742609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:32.799429 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:32.800089 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=11328MB free_disk=72.70183944702148GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:47:32.800262 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:32.800577 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:32.823401 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-changed-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:32.826779 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Refreshing instance network info cache due to event network-changed-093527f6-49e0-45f0-b1c6-d36d937e7d5d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:32.826876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] Acquiring lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:32.827106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] Acquired lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:32.827270 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Refreshing network info cache for port 093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:33.214931 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Detected multiple connections on this host for volume: 68afeadc-26f9-4d0e-a964-e15575723cb9, skipping target disconnect.
May 14 03:47:33.329733 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:33.542575 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:33.542766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:33.641740 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:33.775474 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updated VIF entry in instance network info cache for port 093527f6-49e0-45f0-b1c6-d36d937e7d5d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:33.775733 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating instance_info_cache with network_info: [{"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:33.785634 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:33.859222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:33.877581 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878128 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878231 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878362 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a2050a6c-1c7b-4454-8a7e-14960f06b79b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878524 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance ec948257-bf93-4a61-9944-d5497f04e2ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878609 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 39304f73-2e21-43f5-a634-2e1f42124be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878709 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 608384f9-6f6b-428e-a519-f1631dc5deb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878796 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8e4d162e-d487-4edc-aac5-e52e0df8a125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.878906 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 203f4e13-7bd5-4060-92d1-37674b547f4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.879001 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:47:33.908374 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:33.908478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:33.908506 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:f7:9d:a2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:33.908938 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Using config drive
May 14 03:47:34.044699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:47:34.275462 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:34.275841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:34.277681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5c74546-552a-4100-b991-4e80e7085ba4 req-1d0659e4-7748-4279-9895-dbfae4dd0edb service nova] Releasing lock "refresh_cache-203f4e13-7bd5-4060-92d1-37674b547f4a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:34.381095 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c855e972-ae69-4b13-9b2f-6a588dbc3364 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 03:47:34.381291 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:47:34.381432 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:47:32 up 39 min,  2 users,  load average: 5.02, 6.26, 4.81\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '5', 'io_workload': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '2', 'num_proj_593121a21a7440a48c3f9ec54b7811bd': '1', 'num_proj_71fb53bd4f2841db99df994d7e6c2a72': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_43df7b9472f445dfbf816cb9b648332e': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:47:34.413409 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:34.570182 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Creating config drive at /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.config
May 14 03:47:34.574597 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_481rmdc {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:34.621954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:34.630573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_481rmdc" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:34.777665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:34.777665 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:34.779528 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:47:34.792909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-88965edf-7d13-47dc-a8ba-cc340e7c641b tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.366s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:35.035099 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:35.035278 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:35.084019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.111666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.191089 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.284662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9d9119d-12bb-47e2-81fe-13c2f78e0cdd req-184a8f36-aeae-4455-a687-caf7ef088a6c service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:35.294284 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Detaching volume 68afeadc-26f9-4d0e-a964-e15575723cb9
May 14 03:47:35.296914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d9119d-12bb-47e2-81fe-13c2f78e0cdd req-184a8f36-aeae-4455-a687-caf7ef088a6c service nova] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:35.297241 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d9119d-12bb-47e2-81fe-13c2f78e0cdd req-184a8f36-aeae-4455-a687-caf7ef088a6c service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:35.297412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d9d9119d-12bb-47e2-81fe-13c2f78e0cdd req-184a8f36-aeae-4455-a687-caf7ef088a6c service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:35.297557 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d9d9119d-12bb-47e2-81fe-13c2f78e0cdd req-184a8f36-aeae-4455-a687-caf7ef088a6c service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Processing event network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:35.365456 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:35.371950 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Attempting to driver detach volume 68afeadc-26f9-4d0e-a964-e15575723cb9 from mountpoint /dev/vdb
May 14 03:47:35.379171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:35.380342 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found disk vdb by alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:47:35.380437 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Attempting to detach device vdb from instance 608384f9-6f6b-428e-a519-f1631dc5deb2 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:47:35.380775 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:35.380775 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:35.389520 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 608384f9-6f6b-428e-a519-f1631dc5deb2 from the persistent domain config.
May 14 03:47:35.389684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] (1/8): Attempting to detach device vdb with device alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 from instance 608384f9-6f6b-428e-a519-f1631dc5deb2 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:47:35.389951 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <alias name="ua-68afeadc-26f9-4d0e-a964-e15575723cb9"/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <serial>68afeadc-26f9-4d0e-a964-e15575723cb9</serial>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:35.389951 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:47:35.398196 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.403853 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.423355 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:35.537903 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:35.801326 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730455.8008816, 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:35.801437 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] VM Started (Lifecycle Event)
May 14 03:47:35.802523 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:35.805612 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:35.808993 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance spawned successfully.
May 14 03:47:35.809470 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:36.044393 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:47:36.047658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.244s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:36.047658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.424s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:36.047658 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:36.048892 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:47:36.049009 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Claim successful on node np0000000741
May 14 03:47:36.303969 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:36.306917 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:36.316234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.316415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.316731 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.316953 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.317213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.317469 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:36.809030 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:47:36.809312 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730456.8091085, 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:36.809579 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] VM Paused (Lifecycle Event)
May 14 03:47:36.822923 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Took 7.04 seconds to spawn the instance on the hypervisor.
May 14 03:47:36.823473 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:36.915865 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004219099996589648 future=<Future at 0x79d0b81a0f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:36.916316 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730441.915325, 6e392e3e-de9b-4cf1-801e-29301cb35483 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:36.916469 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:36.916669 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] VM Stopped (Lifecycle Event)
May 14 03:47:37.312227 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:37.316771 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730457.315491, 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:37.316771 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] VM Resumed (Lifecycle Event)
May 14 03:47:37.332242 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Took 12.73 seconds to build instance.
May 14 03:47:37.362464 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:37.363709 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:37.364101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:37.365205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:37.365382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] No waiting events found dispatching network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:37.365531 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-f1305b1d-1fe7-43af-8be7-ddced38923f6 req-c4109069-1771-40e2-a37e-1adfb57f5e6a service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received unexpected event network-vif-plugged-6514bca4-f763-4523-8c91-0dc665bac7eb for instance with vm_state active and task_state None.
May 14 03:47:37.383504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:37.419115 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 6e392e3e-de9b-4cf1-801e-29301cb35483] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:37.684791 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:37.685050 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:37.818299 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:37.821988 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:37.833759 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0f56b274-ed11-4ee4-9f2f-0706f8d25d39 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.244s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:38.042760 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:38.043014 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:38.043225 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:47:38.043477 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.74 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:47:38.187769 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:38.695209 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.650s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:38.695735 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:38.697752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.331s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:38.702801 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:47:38.702801 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Claim successful on node np0000000741
May 14 03:47:38.822870 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730458.8224869, 608384f9-6f6b-428e-a519-f1631dc5deb2 => ua-68afeadc-26f9-4d0e-a964-e15575723cb9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:47:38.823543 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-68afeadc-26f9-4d0e-a964-e15575723cb9 for instance 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:47:38.825862 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully detached device vdb from instance 608384f9-6f6b-428e-a519-f1631dc5deb2 from the live domain config.
May 14 03:47:38.852461 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:47:38.853980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:38.853980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:38.853980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:38.853980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68afeadc-26f9-4d0e-a964-e15575723cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:47:38.853980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:47:38.859848 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9 (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:38.882671 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '162')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '143')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9', '144')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:38.882671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b077c680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:47:38.883939 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Removing multipathed devices sdf, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:47:38.884334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flush multipath device 33000000064d1fb5e {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:47:38.926057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:38.966165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:39.009752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:47:39.009752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:47:39.009752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:47:39.020861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:47:39.021324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:47:39.032086 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.067503 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.40.100,3260]
May 14 03:47:39.067503 np0000000741 nova-compute[97948]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.40.100,3260] successful.
May 14 03:47:39.067503 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.087348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.099605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.142850 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.50.100,3260]
May 14 03:47:39.142850 np0000000741 nova-compute[97948]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-68afeadc-26f9-4d0e-a964-e15575723cb9, portal: 192.168.50.100,3260] successful.
May 14 03:47:39.142850 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.161825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:39.161825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:39.161825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== disconnect_volume: return (306ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:39.161825 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:47:39.201316 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:39.201662 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:39.201940 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:39.204660 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:39.283211 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f875de7ee454dd4ad6918c6794941f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af4cde5a4934c1e8d619ec5b8c8adc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:39.418981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-changed-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:39.419342 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Refreshing instance network info cache due to event network-changed-6514bca4-f763-4523-8c91-0dc665bac7eb. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:39.419520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] Acquiring lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:39.419649 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] Acquired lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:39.419801 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Refreshing network info cache for port 6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:39.640498 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Successfully created port: a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:39.704847 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:39.715292 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'flavor' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:39.921679 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:40.118419 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Successfully updated port: a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:40.210240 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:40.334144 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:40.343559 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:40.343791 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:40.454169 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updated VIF entry in instance network info cache for port 6514bca4-f763-4523-8c91-0dc665bac7eb. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:40.454413 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updating instance_info_cache with network_info: [{"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:40.621822 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:40.621955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:40.622086 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:40.725106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-57792232-fcf0-4b64-a9f4-fa350e7259c1 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.949s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:40.846488 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:40.956095 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d8e49b7-a444-46b1-beb7-35baa013aa4b req-6e4d7757-0654-4be3-b882-16197173e6e9 service nova] Releasing lock "refresh_cache-8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:41.186381 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:41.217469 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:41.218420 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:41.218651 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Creating image(s)
May 14 03:47:41.219061 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:41.219216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:41.219661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:41.219884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:41.220137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:41.356246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.659s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:41.356246 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:41.358431 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:41.496451 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:41.499010 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing instance network info cache due to event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:41.499077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:41.558506 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:41.688624 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:41.690978 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:41.691304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:41.777447 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.part --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:41.778005 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] 2e50787c-049a-4929-814c-528901e4872d was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:47:41.778574 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:47:41.778965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.part /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:41.865739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:41.865904 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:41.866414 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:41.866771 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:41.935219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.part /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.converted" returned: 0 in 0.156s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:41.941940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:41.962952 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cd05bb8cd0642019599037e8f145541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593121a21a7440a48c3f9ec54b7811bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:42.033922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.035656 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.814s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:42.035656 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:42.037722 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:42.038729 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:42.065655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:42.066545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance network_info: |[{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:42.070256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:42.070509 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:42.137861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.138320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:42.138770 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:42.139206 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:42.144985 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:42.145337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:42.250691 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.254024 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85,backing_fmt=raw /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:42.316058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85,backing_fmt=raw /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk 1073741824" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.316778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "b6f04f6a90ce6886e72073b998eac5ef04882d85" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:42.317158 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:42.373716 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:42.386603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:42.420624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6f04f6a90ce6886e72073b998eac5ef04882d85 --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.420988 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:47:42.421270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:42.449337 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Successfully created port: 062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:42.512200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:42.513228 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Cannot resize image /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:47:42.513228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:47:42.513228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Ensure instance console log exists: /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:42.514237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:42.514237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:42.514237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:42.515887 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Start _get_guest_xml network_info=[{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:47:31Z,direct_url=<?>,disk_format='qcow2',id=2e50787c-049a-4929-814c-528901e4872d,min_disk=0,min_ram=0,name='tempest-scenario-img--1114033141',owner='6af4cde5a4934c1e8d619ec5b8c8adc9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:47:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '2e50787c-049a-4929-814c-528901e4872d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:42.520309 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:42.521776 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2e50787c-049a-4929-814c-528901e4872d', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1955071959', uuid='c855e972-ae69-4b13-9b2f-6a588dbc3364'), owner=OwnerMeta(userid='8f875de7ee454dd4ad6918c6794941f1', username='tempest-TestMinimumBasicScenario-1441934481-project-member', projectid='6af4cde5a4934c1e8d619ec5b8c8adc9', projectname='tempest-TestMinimumBasicScenario-1441934481'), image=ImageMeta(id='2e50787c-049a-4929-814c-528901e4872d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730462.5213857) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:42.524851 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:42.525199 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:42.526124 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:42.526298 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:42.527503 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:42.527664 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:47:31Z,direct_url=<?>,disk_format='qcow2',id=2e50787c-049a-4929-814c-528901e4872d,min_disk=0,min_ram=0,name='tempest-scenario-img--1114033141',owner='6af4cde5a4934c1e8d619ec5b8c8adc9',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:47:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:42.527804 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:42.527885 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:42.528015 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:42.528093 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:42.528204 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:42.529072 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:42.529072 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:42.529072 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:42.529072 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:42.529072 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:42.539440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1955071959',display_name='tempest-TestMinimumBasicScenario-server-1955071959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-1955071959',id=65,image_ref='2e50787c-049a-4929-814c-528901e4872d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlb4p5DOKf7B8WGaE4FF4FxVG4Rr1dpW63ZklDT+NcxE0f3vzpVR//WojgVbp1VqVQnVCjQ8Bu1QUA4Gihf/SvRIROiEHFfo6JnVWP1KLjBFxrRPiCvWK5VA4VEdDh1w==',key_name='tempest-TestMinimumBasicScenario-1434517968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-6p0fcc08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2e50787c-049a-4929-814c-528901e4872d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:40Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=c855e972-ae69-4b13-9b2f-6a588dbc3364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:42.539669 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:42.540163 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:42.541201 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'pci_devices' on Instance uuid c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:42.577475 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:42.877726 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:42.887103 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:42.969925 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Successfully updated port: 062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:43.038499 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updated VIF entry in instance network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:43.038739 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:43.044013 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <uuid>c855e972-ae69-4b13-9b2f-6a588dbc3364</uuid>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <name>instance-00000041</name>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestMinimumBasicScenario-server-1955071959</nova:name>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:42</nova:creationTime>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:image uuid="2e50787c-049a-4929-814c-528901e4872d">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:properties/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:user uuid="8f875de7ee454dd4ad6918c6794941f1">tempest-TestMinimumBasicScenario-1441934481-project-member</nova:user>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:project uuid="6af4cde5a4934c1e8d619ec5b8c8adc9">tempest-TestMinimumBasicScenario-1441934481</nova:project>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="2e50787c-049a-4929-814c-528901e4872d"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         <nova:port uuid="a05fffde-eb69-4f28-8b37-639c483601f3">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="serial">c855e972-ae69-4b13-9b2f-6a588dbc3364</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="uuid">c855e972-ae69-4b13-9b2f-6a588dbc3364</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.config"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:fe:d5:87"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <target dev="tapa05fffde-eb"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/console.log" append="off"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:43.044013 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:43.045916 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Preparing to wait for external event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:43.045916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:43.045916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:43.046025 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:43.046924 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1955071959',display_name='tempest-TestMinimumBasicScenario-server-1955071959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-1955071959',id=65,image_ref='2e50787c-049a-4929-814c-528901e4872d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlb4p5DOKf7B8WGaE4FF4FxVG4Rr1dpW63ZklDT+NcxE0f3vzpVR//WojgVbp1VqVQnVCjQ8Bu1QUA4Gihf/SvRIROiEHFfo6JnVWP1KLjBFxrRPiCvWK5VA4VEdDh1w==',key_name='tempest-TestMinimumBasicScenario-1434517968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-6p0fcc08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2e50787c-049a-4929-814c-528901e4872d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:40Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=c855e972-ae69-4b13-9b2f-6a588dbc3364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:43.047384 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:43.047976 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:43.048969 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:43.050280 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.050711 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:43.050892 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:43.052656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:43.053497 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing instance network info cache due to event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:43.053717 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] Acquiring lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:43.053848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] Acquired lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:43.054016 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing network info cache for port 062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:43.057803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.058239 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd82ae05a-2114-5bef-9459-f2873624ff0c', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:43.073003 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.073985 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:43.076397 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.076565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa05fffde-eb, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:43.076914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa05fffde-eb, col_values=(('qos', UUID('2f514a60-c5e5-44a9-be4c-dfac80f12a1a')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:43.077106 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa05fffde-eb, col_values=(('external_ids', {'iface-id': 'a05fffde-eb69-4f28-8b37-639c483601f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:d5:87', 'vm-uuid': 'c855e972-ae69-4b13-9b2f-6a588dbc3364'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:43.079140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.080775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:43.084737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.086472 np0000000741 nova-compute[97948]: INFO os_vif [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb')
May 14 03:47:43.375677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:43.375677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:43.472103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:43.540443 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-75778f38-3f08-48be-a09f-9c4fca3d7ffd req-6ab079b0-8472-47f3-a3fe-d1b9e22d35bb service nova] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:43.558200 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:43.624518 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:43.761246 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:43.861096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:43.876768 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:47:43.887297 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:43.888965 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:43.889203 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Creating image(s)
May 14 03:47:43.889632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:43.889799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:43.890240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:43.890473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:43.891161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:44.263110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-41254099-a922-4ba4-82da-211e82dee505 req-0c814d41-b9c1-4971-a2ff-52044861092a service nova] Releasing lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:44.263804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquired lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:44.264005 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:44.454976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:44.455330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:44.459193 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:47:44.459392 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Claim successful on node np0000000741
May 14 03:47:44.605006 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:44.605205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:44.605289 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No VIF found with MAC fa:16:3e:fe:d5:87, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:44.605761 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Using config drive
May 14 03:47:44.659258 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:44.661675 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:44.662039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.part --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:44.771318 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.part --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:44.771814 np0000000741 nova-compute[97948]: DEBUG nova.virt.images [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] e5ef9e9d-d918-444a-8a75-e38f3e997215 was qcow2, converting to raw {{(pid=97948) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 03:47:44.772610 np0000000741 nova-compute[97948]: DEBUG nova.privsep.utils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97948) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 03:47:44.772955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.part /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.converted {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:44.857128 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:44.920445 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.part /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.converted" returned: 0 in 0.147s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:44.933018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.converted --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.032425 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9.converted --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.033150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.142s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:45.033587 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:45.039962 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:45.043553 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.093521 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:45.113082 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:45.148038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.148383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:45.148774 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:45.149116 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:45.151635 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:47:45.151948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.259662 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json" returned: 0 in 0.107s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.260260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9,backing_fmt=raw /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.312275 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Creating config drive at /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.config
May 14 03:47:45.315892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4q9r48su {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.335073 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:45.341728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9,backing_fmt=raw /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk 1073741824" returned: 0 in 0.079s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.343195 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "9679cf16e559d941259c2ce30a60743c19c9f7d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:45.343681 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:45.391724 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4q9r48su" returned: 0 in 0.075s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.439989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9679cf16e559d941259c2ce30a60743c19c9f7d9 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:45.440710 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:47:45.440975 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Ensure instance console log exists: /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:45.441329 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:45.441617 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:45.441828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:45.839599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Releasing lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:45.840096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance network_info: |[{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:45.842224 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Start _get_guest_xml network_info=[{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='e3200ee55fc0dbea490344548cca64b1',container_format='bare',created_at=2026-05-14T03:47:24Z,direct_url=<?>,disk_format='qcow2',id=e5ef9e9d-d918-444a-8a75-e38f3e997215,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-41240497',owner='593121a21a7440a48c3f9ec54b7811bd',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-14T03:47:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': 'e5ef9e9d-d918-444a-8a75-e38f3e997215'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:45.846039 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:45.847372 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1007201020', uuid='65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb'), owner=OwnerMeta(userid='8cd05bb8cd0642019599037e8f145541', username='tempest-TestStampPattern-671027015-project-member', projectid='593121a21a7440a48c3f9ec54b7811bd', projectname='tempest-TestStampPattern-671027015'), image=ImageMeta(id='e5ef9e9d-d918-444a-8a75-e38f3e997215', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '593121a21a7440a48c3f9ec54b7811bd'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730465.8469334) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:45.853396 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:45.859376 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:45.860342 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:45.861694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:45.862095 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:45.863176 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:45.863470 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e3200ee55fc0dbea490344548cca64b1',container_format='bare',created_at=2026-05-14T03:47:24Z,direct_url=<?>,disk_format='qcow2',id=e5ef9e9d-d918-444a-8a75-e38f3e997215,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-41240497',owner='593121a21a7440a48c3f9ec54b7811bd',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-14T03:47:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:45.863602 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:45.863694 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:45.863846 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:45.863884 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:45.863957 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:45.864267 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:45.864267 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:45.864631 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:45.864746 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:45.864854 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:45.884695 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:45.887186 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1007201020',display_name='tempest-TestStampPattern-server-1007201020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1007201020',id=66,image_ref='e5ef9e9d-d918-444a-8a75-e38f3e997215',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-b63s9ou6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='39304f73-2e21-43f5-a634-2e1f42124be5',image_min_disk='1',image_min_ram='0',image_owner_id='593121a21a7440a48c3f9ec54b7811bd',image_owner_project_name='tempest-TestStampPattern-671027015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-671027015-project-member',image_user_id='8cd05bb8cd0642019599037e8f145541',network_allocated='True',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:43Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:45.887424 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:45.888316 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:45.889124 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'pci_devices' on Instance uuid 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:45.993348 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.037397 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fa9858bf-cc32-4934-8c11-c0beb0a2ab70 req-d3d62998-3f1b-45c2-a905-e98dfc8b3bb8 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:46.037397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa9858bf-cc32-4934-8c11-c0beb0a2ab70 req-d3d62998-3f1b-45c2-a905-e98dfc8b3bb8 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:46.037513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa9858bf-cc32-4934-8c11-c0beb0a2ab70 req-d3d62998-3f1b-45c2-a905-e98dfc8b3bb8 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:46.038417 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fa9858bf-cc32-4934-8c11-c0beb0a2ab70 req-d3d62998-3f1b-45c2-a905-e98dfc8b3bb8 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:46.039798 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fa9858bf-cc32-4934-8c11-c0beb0a2ab70 req-d3d62998-3f1b-45c2-a905-e98dfc8b3bb8 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Processing event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:46.196912 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.201910 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.206937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.219833 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:47:46.219833 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:47:46.232550 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.235069 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.392192 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <uuid>65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb</uuid>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <name>instance-00000042</name>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestStampPattern-server-1007201020</nova:name>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:45</nova:creationTime>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:property name="img_owner_id">593121a21a7440a48c3f9ec54b7811bd</nova:property>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:user uuid="8cd05bb8cd0642019599037e8f145541">tempest-TestStampPattern-671027015-project-member</nova:user>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:project uuid="593121a21a7440a48c3f9ec54b7811bd">tempest-TestStampPattern-671027015</nova:project>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         <nova:port uuid="062e9b78-b3d4-4377-af3b-0c3446844a59">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="serial">65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="uuid">65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.config"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:8d:42:2e"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <target dev="tap062e9b78-b3"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/console.log" append="off"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:46.392192 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Preparing to wait for external event network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1007201020',display_name='tempest-TestStampPattern-server-1007201020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1007201020',id=66,image_ref='e5ef9e9d-d918-444a-8a75-e38f3e997215',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-b63s9ou6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='39304f73-2e21-43f5-a634-2e1f42124be5',image_min_disk='1',image_min_ram='0',image_owner_id='593121a21a7440a48c3f9ec54b7811bd',image_owner_project_name='tempest-TestStampPattern-671027015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-671027015-project-member',image_user_id='8cd05bb8cd0642019599037e8f145541',network_allocated='True',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:43Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.395906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:46.396572 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:46.396975 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.397228 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a53b89f0-e726-5825-a1b7-5537e0e6f192', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:46.405510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.406683 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:46.407474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.410308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.410520 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap062e9b78-b3, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:46.411006 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap062e9b78-b3, col_values=(('qos', UUID('18c77b68-593f-4555-bb6c-0889c3ba54d6')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:46.411267 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap062e9b78-b3, col_values=(('external_ids', {'iface-id': '062e9b78-b3d4-4377-af3b-0c3446844a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:42:2e', 'vm-uuid': '65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:46.412289 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.414012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:46.419847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:46.420794 np0000000741 nova-compute[97948]: INFO os_vif [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3')
May 14 03:47:46.692675 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730466.6922207, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:46.692995 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:46.693153 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Started (Lifecycle Event)
May 14 03:47:46.698739 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:46.701295 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance spawned successfully.
May 14 03:47:46.701685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:46.722556 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:47:47.195739 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:47.197779 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:47.207713 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.207884 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.208109 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.208329 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.208689 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.208906 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:47.230168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.775s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:47.230458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:47:47.700332 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:47:47.700590 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730467.7003968, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:47.700736 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Paused (Lifecycle Event)
May 14 03:47:47.713810 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Took 6.50 seconds to spawn the instance on the hypervisor.
May 14 03:47:47.714160 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:47.736270 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:47:47.736412 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:47:47.736725 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:47.736973 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:47.806903 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c064a5847d91427796b822208d60fa59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ffe6f2dced4996934bb21b97bd6dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:47:47.941535 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:47.941681 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:47.941753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No VIF found with MAC fa:16:3e:8d:42:2e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:47.942155 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Using config drive
May 14 03:47:48.118216 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:48.120053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:48.120278 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:48.120471 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:48.120610 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:48.120789 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-80791a79-a024-44de-bc27-5292f0f23cc5 req-69fbf7d9-591c-49ca-b25a-5cd3a75625cb service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received unexpected event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with vm_state active and task_state None.
May 14 03:47:48.186458 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Successfully created port: 7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:47:48.203822 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:48.205843 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730468.205597, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:48.206003 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Resumed (Lifecycle Event)
May 14 03:47:48.225999 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Took 13.68 seconds to build instance.
May 14 03:47:48.241278 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:47:48.448592 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:48.588459 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Creating config drive at /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.config
May 14 03:47:48.591876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyrkswjmr {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:48.656389 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyrkswjmr" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:48.711494 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:48.711494 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Successfully updated port: 7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:47:48.714835 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:48.730314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.187s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:48.747475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:47:48.766666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-changed-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:48.766829 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Refreshing instance network info cache due to event network-changed-7a665605-45a5-4db7-ae03-ff5875248f22. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:48.766958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] Acquiring lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:48.767048 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] Acquired lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:48.767216 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Refreshing network info cache for port 7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:48.865365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.153829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.181305 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.183993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.213798 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:49.255348 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Booting with volume 509504a3-cdd9-4d67-9f4c-5e06000f291a at /dev/vda
May 14 03:47:49.268930 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:49.291821 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.302856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.304725 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:49.314778 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:49.328309 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:47:49.350213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:49.368946 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:49.404635 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:47:49.404879 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:47:49.417987 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:47:49.419445 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe08:45ee', 'fe80::fc16:3eff:fe9a:3cec', 'fe80::34ec:6bff:feb3:d1f', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8'] 
May 14 03:47:49.419589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:47:49.419682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:47:49.419941 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:49.420163 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Updating existing volume attachment record: 35a5171a-8828-49a4-9a90-5fdf1f000fcd {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:47:49.553130 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:49.995025 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730469.9945955, 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:49.995749 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] VM Started (Lifecycle Event)
May 14 03:47:50.055592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-55632634-e4f4-470c-aae8-cd54240852ef req-1b195215-69ce-4293-bc01-65b34237e2d9 service nova] Releasing lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:50.056459 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquired lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:50.056671 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:47:50.195399 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:50.195594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:50.195779 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:50.195905 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:50.196021 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Processing event network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:50.198696 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:50.198848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:50.198976 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:50.200081 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:50.200293 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:50.200418 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] No waiting events found dispatching network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:50.200530 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-faa90a97-51f2-40b9-a287-071b24e9d1f2 req-5094a3a2-ac01-4670-8f92-a762f5325da7 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received unexpected event network-vif-plugged-062e9b78-b3d4-4377-af3b-0c3446844a59 for instance with vm_state building and task_state spawning.
May 14 03:47:50.205915 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:50.208507 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance spawned successfully.
May 14 03:47:50.208874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:50.211938 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:50.213245 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:50.255174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:50.255583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:50.498245 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:50.501106 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:50.626181 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:47:50.723772 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Took 6.84 seconds to spawn the instance on the hypervisor.
May 14 03:47:50.724717 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:50.758651 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:50.776047 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:50.917677 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Updating instance_info_cache with network_info: [{"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:51.005411 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:47:51.005714 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730471.0055046, 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:51.005861 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] VM Paused (Lifecycle Event)
May 14 03:47:51.243228 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Took 15.96 seconds to build instance.
May 14 03:47:51.413850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:51.419474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Releasing lock "refresh_cache-79f1d098-e1d8-4e10-b9e1-d55dea015415" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:51.419741 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance network_info: |[{"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:47:51.509023 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:51.511875 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730471.5116532, 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:51.511984 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] VM Resumed (Lifecycle Event)
May 14 03:47:51.532630 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:47:51.533802 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:47:51.534076 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Creating image(s)
May 14 03:47:51.534397 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:47:51.534553 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Ensure instance console log exists: /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:47:51.534848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:51.535055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:51.535208 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:51.535760 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Start _get_guest_xml network_info=[{"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '79f1d098-e1d8-4e10-b9e1-d55dea015415', 'attached_at': '', 'detached_at': '', 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'serial': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'multiattach': True}, 'boot_index': 0, 'attachment_id': '35a5171a-8828-49a4-9a90-5fdf1f000fcd', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:47:51.538266 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:47:51.539557 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1194545476', uuid='79f1d098-e1d8-4e10-b9e1-d55dea015415'), owner=OwnerMeta(userid='c064a5847d91427796b822208d60fa59', username='tempest-AttachVolumeMultiAttachTest-221885421-project-member', projectid='67ffe6f2dced4996934bb21b97bd6dda', projectname='tempest-AttachVolumeMultiAttachTest-221885421'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730471.5392056) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:47:51.540622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:47:51.541028 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:47:51.542080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:47:51.542281 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:47:51.543570 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:47:51.543923 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:47:51.544132 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:47:51.544294 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:47:51.544461 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:47:51.544581 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:47:51.544738 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:47:51.544941 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:47:51.545089 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:47:51.545240 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:47:51.545381 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:47:51.545534 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:47:51.564219 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:47:51.564650 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:51.564837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:51.565290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:51.565528 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:47:51.580551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:51.581620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:51.581780 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:51.582787 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:51.582787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:51.582787 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:51.594735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:51.594735 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:51.603808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:51.603808 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:51.610231 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a] added
May 14 03:47:51.610231 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:51.610231 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:51.610231 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:51.610231 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:51.610231 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:51.610231 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:51.610844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:51.610844 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:51.610844 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a] added
May 14 03:47:51.617160 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:51.617160 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:51.617160 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:51.617754 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:51.745310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.469s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:51.763623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:52.015018 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:52.016971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:52.580057 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:52.580493 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing instance network info cache due to event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:47:52.580493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] Acquiring lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:47:52.580658 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] Acquired lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:47:52.580811 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing network info cache for port 062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:47:52.611544 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:52.617705 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:52.625470 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:52.625470 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:52.632860 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:52.632860 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.640441 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.646421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.655532 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.655912 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.665255 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.665543 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:52.701226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.40.100,3260]
May 14 03:47:52.701226 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.40.100,3260] successful.
May 14 03:47:52.701226 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.706854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.50.100,3260]
May 14 03:47:52.706854 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.50.100,3260] successful.
May 14 03:47:52.706854 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.713628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.721397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.733174 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('7', '-', '-', 0) found on session 163 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:52.733174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.738522 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:52.738896 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:52.739158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:52.739158 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:52.740259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] HCTL ('8', '-', '-', 0) found on session 164 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:52.740405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:52.761107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 163 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:52.761107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:52.761107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Searching for a device in session 164 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:52.761107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:52.863728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:52.863728 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:52.863728 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Attaching volume e0105d07-8117-4b31-a348-332a3d89e05f to /dev/vdb
May 14 03:47:52.908313 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:52.927239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:47:52.955660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:53.004862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:47:53.005140 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:47:53.012570 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:47:53.014004 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fefb:7d70', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe08:45ee', 'fe80::fc16:3eff:fe9a:3cec', 'fe80::34ec:6bff:feb3:d1f', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8'] 
May 14 03:47:53.014119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:47:53.014282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:47:53.014495 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:53.014812 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating existing volume attachment record: fd454009-fdf2-47ee-bf8b-417b03f7536d {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:47:53.083195 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:53.410522 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updated VIF entry in instance network info cache for port 062e9b78-b3d4-4377-af3b-0c3446844a59. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:47:53.604676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:47:53.867568 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:54.084254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e7352b2c-efef-4968-81b7-583d1888de6f req-4c1e03ee-b023-4d0b-9d85-5fea69dc4de5 service nova] Releasing lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:47:54.602176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Found WWN 3300000008f6800e8 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:47:54.602564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:54.602744 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000008f6800e8', 'path': '/dev/dm-0', 'multipath_id': '3300000008f6800e8'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:54.602865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f6800e8', 'path': '/dev/dm-0', 'multipath_id': '3300000008f6800e8'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:47:54.603450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.037s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:54.603781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:47:54.617606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:54.618159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:54.619316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:54.619316 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:54.620831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:54.620831 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:54.634218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:54.634218 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:54.638778 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:47:54.638778 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f] added
May 14 03:47:54.646895 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:54.646895 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:54.646895 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:54.650804 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f] added
May 14 03:47:54.650804 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:47:54.650804 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:54.650804 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:54.650804 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:47:54.650804 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:47:54.650804 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:54.651069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:47:54.651257 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:47:54.651336 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:47:55.111214 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1194545476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1194545476',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-x7d8l8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:49Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=79f1d098-e1d8-4e10-b9e1-d55dea015415,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:47:55.111412 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:55.111880 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:55.112537 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'pci_devices' on Instance uuid 79f1d098-e1d8-4e10-b9e1-d55dea015415 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:55.615287 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] End _get_guest_xml xml=<domain type="qemu">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <uuid>79f1d098-e1d8-4e10-b9e1-d55dea015415</uuid>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <name>instance-00000043</name>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1194545476</nova:name>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:47:51</nova:creationTime>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:user uuid="c064a5847d91427796b822208d60fa59">tempest-AttachVolumeMultiAttachTest-221885421-project-member</nova:user>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:project uuid="67ffe6f2dced4996934bb21b97bd6dda">tempest-AttachVolumeMultiAttachTest-221885421</nova:project>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         <nova:port uuid="7a665605-45a5-4db7-ae03-ff5875248f22">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <system>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="serial">79f1d098-e1d8-4e10-b9e1-d55dea015415</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="uuid">79f1d098-e1d8-4e10-b9e1-d55dea015415</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </system>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <os>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </os>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <features>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </features>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   <devices>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/disk.config"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <alias name="ua-509504a3-cdd9-4d67-9f4c-5e06000f291a"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <serial>509504a3-cdd9-4d67-9f4c-5e06000f291a</serial>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <shareable/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </disk>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:06:3b:d0"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <target dev="tap7a665605-45"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </interface>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/console.log" append="off"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </serial>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <video>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </video>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </rng>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:   </devices>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]: </domain>
May 14 03:47:55.615287 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Preparing to wait for external event network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:47:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1194545476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1194545476',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-x7d8l8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:47:49Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=79f1d098-e1d8-4e10-b9e1-d55dea015415,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:47:55.618583 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:55.620557 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:55.620557 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:47:55.620772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.621060 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:55.621269 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:47:55.624741 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.625019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c11f8984-2633-573a-8f31-9a5abec43eb0', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:55.628128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.629146 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:55.629904 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.633344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.633499 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a665605-45, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:55.633829 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a665605-45, col_values=(('qos', UUID('afe42702-5ab8-4ecc-ab39-0eac8ae71f29')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:55.634080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a665605-45, col_values=(('external_ids', {'iface-id': '7a665605-45a5-4db7-ae03-ff5875248f22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:3b:d0', 'vm-uuid': '79f1d098-e1d8-4e10-b9e1-d55dea015415'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:55.634857 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.636055 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:55.644365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:55.645305 np0000000741 nova-compute[97948]: INFO os_vif [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45')
May 14 03:47:55.647520 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:47:55.651752 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:55.662938 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:55.662938 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:47:55.676865 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:47:55.676865 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.680784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.692345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.701779 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.715038 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.715278 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:55.740696 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.40.100,3260]
May 14 03:47:55.740696 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.40.100,3260] successful.
May 14 03:47:55.740696 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.755793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.767831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.50.100,3260]
May 14 03:47:55.767831 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.50.100,3260] successful.
May 14 03:47:55.767831 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.778119 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('10', '-', '-', 0) found on session 165 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:55.778119 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:55.785627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:55.797287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 165 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:55.797287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.809264 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:55.809985 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:55.810171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:55.810445 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:47:55.811751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] HCTL ('11', '-', '-', 0) found on session 166 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:47:55.811751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:47:55.829709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Searching for a device in session 166 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:47:55.830011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:47:56.621570 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:47:57.103849 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:57.104016 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:57.104154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:57.104224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:57.104341 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:57.107042 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Terminating instance
May 14 03:47:57.170501 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:57.170700 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:57.170860 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] No VIF found with MAC fa:16:3e:06:3b:d0, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:47:57.171308 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Using config drive
May 14 03:47:57.611411 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:47:57.641272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found WWN 33000000014fb94cf for multipath device dm-10 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:47:57.641701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:57.641753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== connect_volume: return (4075ms) {'type': 'block', 'scsi_wwn': '33000000014fb94cf', 'path': '/dev/dm-10', 'multipath_id': '33000000014fb94cf'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:57.641869 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014fb94cf', 'path': '/dev/dm-10', 'multipath_id': '33000000014fb94cf'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:47:57.644740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:57.660017 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:57.668282 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:57.677279 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:57.775019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:57.788185 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:57.853534 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Creating config drive at /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/disk.config
May 14 03:47:57.855862 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:57.856135 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:57.856218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:57.856317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:57.856421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] No waiting events found dispatching network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:57.856563 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15e18e4a-ed53-4f82-9932-d089f4e82eb7 req-64beb9c9-e2c1-49e0-8ec7-cb244bb3f6a1 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:57.863978 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzfwj4ba {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:47:57.924111 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:57.943298 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzfwj4ba" returned: 0 in 0.079s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:47:57.971092 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999489979999908 future=<Future at 0x79d0905d34a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:57.972757 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.997991387000184 future=<Future at 0x79d0905d34a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:57.972757 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.997829398000249 future=<Future at 0x79d0905d34a0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:47:57.979583 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Instance destroyed successfully.
May 14 03:47:57.980353 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid 8e4d162e-d487-4edc-aac5-e52e0df8a125 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:47:58.166684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Attempting to attach volume e0105d07-8117-4b31-a348-332a3d89e05f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:47:58.170413 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:   <alias name="ua-e0105d07-8117-4b31-a348-332a3d89e05f"/>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-10"/>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:   <serial>e0105d07-8117-4b31-a348-332a3d89e05f</serial>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]: </disk>
May 14 03:47:58.170413 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:47:58.483609 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-982457202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-image-snapshot-server-982457202',id=62,image_ref='8b9a7948-0850-4599-9ad1-8de27358316a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOnBXAjZWxuE/vvqK2PKYUxujAs/Hicf/LPi5QJtJEFJpMjjREah5YCwOQxMazHsuztRZjud/pPf/u+SYEwLwl9N8Kh95MOzonAw8mdY0e4lyr4EyZrz1rsQjb3aN5WAA==',key_name='tempest-keypair-1227955810',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:18Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-mb1p5ob3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1781728370',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=8e4d162e-d487-4edc-aac5-e52e0df8a125,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:47:58.483939 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "address": "fa:16:3e:08:45:ee", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dd1ed39-95", "ovs_interfaceid": "7dd1ed39-95a8-4d02-838b-d9b0aa58c11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:47:58.487662 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:47:58.487662 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:47:58.487662 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.487662 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dd1ed39-95, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:58.488420 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.489338 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:58.495947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.497792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.498034 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48a8690f-6b52-4f2b-b1c4-e60b58e2f1dd) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:47:58.498888 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.499837 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:47:58.501224 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.538785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.544395 np0000000741 nova-compute[97948]: INFO os_vif [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:45:ee,bridge_name='br-int',has_traffic_filtering=True,id=7dd1ed39-95a8-4d02-838b-d9b0aa58c11c,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dd1ed39-95')
May 14 03:47:58.547786 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:47:58.547786 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.548246 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:47:58.548461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:47:58.549012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:47:58.549349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:47:58.549544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:47:58.580208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:47:58.580208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '162')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:58.581696 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b', '161')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:47:58.583861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b0035440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:47:58.583861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdk, sdj {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:47:58.583978 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000e3b72f19 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:47:58.620019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.638456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.638456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.641340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:58.699216 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1e47159a-faa9-43f8-ae4a-130fcf0be5b0 req-f9f17e11-34fe-4740-b3ed-c652331e5af2 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:58.700038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1e47159a-faa9-43f8-ae4a-130fcf0be5b0 req-f9f17e11-34fe-4740-b3ed-c652331e5af2 service nova] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:58.700240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1e47159a-faa9-43f8-ae4a-130fcf0be5b0 req-f9f17e11-34fe-4740-b3ed-c652331e5af2 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:58.700386 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1e47159a-faa9-43f8-ae4a-130fcf0be5b0 req-f9f17e11-34fe-4740-b3ed-c652331e5af2 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:58.700553 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1e47159a-faa9-43f8-ae4a-130fcf0be5b0 req-f9f17e11-34fe-4740-b3ed-c652331e5af2 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Processing event network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:47:58.707325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:47:58.752082 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:47:58.752344 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:47:58.753733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:47:58.766544 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:47:58.766741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:47:58.779810 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.817689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.40.100,3260]
May 14 03:47:58.817689 np0000000741 nova-compute[97948]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.40.100,3260] successful.
May 14 03:47:58.817689 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.836062 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.847270 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.869429 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:47:58.877803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.50.100,3260]
May 14 03:47:58.877803 np0000000741 nova-compute[97948]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b, portal: 192.168.50.100,3260] successful.
May 14 03:47:58.877803 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.898909 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:47:58.899126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:47:58.899251 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (350ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:47:58.899352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:47:58.899669 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Deleting instance files /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125_del
May 14 03:47:58.900202 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Deletion of /opt/stack/data/nova/instances/8e4d162e-d487-4edc-aac5-e52e0df8a125_del complete
May 14 03:47:59.328016 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730479.3275714, 79f1d098-e1d8-4e10-b9e1-d55dea015415 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:47:59.328186 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] VM Started (Lifecycle Event)
May 14 03:47:59.330329 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:47:59.338254 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:47:59.341299 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance spawned successfully.
May 14 03:47:59.341833 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:47:59.406606 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Took 1.79 seconds to destroy the instance on the hypervisor.
May 14 03:47:59.407502 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:47:59.407871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:47:59.408129 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:47:59.408535 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:59.550819 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:47:59.831099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:47:59.833348 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:47:59.852943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.852943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.854753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.854753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.854753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.854753 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:47:59.932064 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:47:59.932237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] Acquiring lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:47:59.932400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:47:59.932555 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:47:59.932699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] No waiting events found dispatching network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:47:59.933193 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b192a7a5-c217-46fd-90c7-77eacb19a6ba req-a07a3790-1695-4090-bdb2-8bf61d903261 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-unplugged-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:47:59.935630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:59.935931 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:59.936188 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:47:59.936357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] No VIF found with MAC fa:16:3e:fe:d5:87, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:00.336921 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:48:00.337188 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730480.3370152, 79f1d098-e1d8-4e10-b9e1-d55dea015415 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:00.337317 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] VM Paused (Lifecycle Event)
May 14 03:48:00.359777 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Took 8.83 seconds to spawn the instance on the hypervisor.
May 14 03:48:00.359777 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:00.462009 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:00.756306 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:00.757412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:00.757749 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:00.757929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:00.758031 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] No waiting events found dispatching network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:00.758234 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received unexpected event network-vif-plugged-7a665605-45a5-4db7-ae03-ff5875248f22 for instance with vm_state active and task_state None.
May 14 03:48:00.758328 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d5cb19cd-b44c-4251-882a-326125d06d90 req-c16890be-91a6-4ef4-a29e-4b023eb0ea55 service nova] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Received event network-vif-deleted-7dd1ed39-95a8-4d02-838b-d9b0aa58c11c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:00.842447 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:00.845081 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730480.8447258, 79f1d098-e1d8-4e10-b9e1-d55dea015415 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:00.845584 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] VM Resumed (Lifecycle Event)
May 14 03:48:00.868250 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Took 16.49 seconds to build instance.
May 14 03:48:00.963097 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Took 1.55 seconds to deallocate network for instance.
May 14 03:48:01.348320 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:01.351397 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:01.370018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.994s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:01.501385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3ded53a3-dd67-4eda-bd6e-7d8ad92cd7cd tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.643s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:01.546960 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Took 0.58 seconds to detach 1 volumes for instance.
May 14 03:48:01.550788 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Deleting volume: aebc3a08-6ff5-4bf0-afc0-a8ef6b71c83b {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:48:02.108804 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:02.109263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:02.725222 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:02.725694 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing instance network info cache due to event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:02.725904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:02.726057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:02.726195 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:02.926659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:02.926940 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:03.228535 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:03.431449 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:03.500238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:03.712898 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:03.871654 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:03.897154 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updated VIF entry in instance network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:03.897509 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:03.942147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.833s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:04.009526 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance 8e4d162e-d487-4edc-aac5-e52e0df8a125
May 14 03:48:04.150105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:04.150260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:04.150359 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:04.150455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:04.150692 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:04.152550 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Terminating instance
May 14 03:48:04.402351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b1c7dde3-5f40-4a6f-ab55-e3bb34dedd15 req-a452a7fc-d4ac-4e33-9e0b-5e85ba898240 service nova] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:04.435354 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:04.435917 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing instance network info cache due to event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:04.435957 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:04.436051 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:04.436203 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:04.657622 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:04.679755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:04.684071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:04.703716 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:04.820508 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:04.828632 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:04.848333 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:04.848496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:04.851289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:04.851289 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:04.851289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] No waiting events found dispatching network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:04.851289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e5a8ecf0-e5f6-4605-accf-08295fe62da0 req-d6da0193-1709-4eeb-a6a4-381da4520967 service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:04.938127 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:05.004904 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999732006000158 future=<Future at 0x79d090737500 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:05.008702 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Instance destroyed successfully.
May 14 03:48:05.009001 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid 79f1d098-e1d8-4e10-b9e1-d55dea015415 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:05.017924 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27717705-f861-4df5-91b8-19f631170907 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "8e4d162e-d487-4edc-aac5-e52e0df8a125" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.914s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:05.258202 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:05.383689 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updated VIF entry in instance network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:05.384063 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:05.512241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:47:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1194545476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1194545476',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:48:00Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-x7d8l8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:48:00Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=79f1d098-e1d8-4e10-b9e1-d55dea015415,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:05.512724 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "7a665605-45a5-4db7-ae03-ff5875248f22", "address": "fa:16:3e:06:3b:d0", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a665605-45", "ovs_interfaceid": "7a665605-45a5-4db7-ae03-ff5875248f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:05.512886 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:05.513054 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:05.513993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:05.514276 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a665605-45, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:05.517014 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:05.517014 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:05.517569 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:05.517761 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afe42702-5ab8-4ecc-ab39-0eac8ae71f29) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:05.519331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:05.519331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:05.520811 np0000000741 nova-compute[97948]: INFO os_vif [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:d0,bridge_name='br-int',has_traffic_filtering=True,id=7a665605-45a5-4db7-ae03-ff5875248f22,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a665605-45')
May 14 03:48:05.547514 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:05.547828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:05.547942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:05.548199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:05.548449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '509504a3-cdd9-4d67-9f4c-5e06000f291a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:05.548570 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:05.575939 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:05.576289 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:05.576289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '163')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:05.577104 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a', '164')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:05.577876 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b829ae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:05.578038 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:05.578254 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flush multipath device 3300000008f6800e8 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:05.642462 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:05.689028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:05.723977 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:05.724180 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:05.725533 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:05.736519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:05.736715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:05.750616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.788901 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.40.100,3260]
May 14 03:48:05.788901 np0000000741 nova-compute[97948]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.40.100,3260] successful.
May 14 03:48:05.788901 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.805606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.817623 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.850222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.50.100,3260]
May 14 03:48:05.850222 np0000000741 nova-compute[97948]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-509504a3-cdd9-4d67-9f4c-5e06000f291a, portal: 192.168.50.100,3260] successful.
May 14 03:48:05.850222 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.865974 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:05.866309 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:05.866478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== disconnect_volume: return (318ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:05.866623 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:05.866931 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Deleting instance files /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415_del
May 14 03:48:05.867624 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Deletion of /opt/stack/data/nova/instances/79f1d098-e1d8-4e10-b9e1-d55dea015415_del complete
May 14 03:48:05.887068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de12b320-0869-4064-871b-aa985f5fa959 req-08efa52a-9071-40c1-b5a1-b7d56c5a9b36 service nova] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:06.373462 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Took 1.72 seconds to destroy the instance on the hypervisor.
May 14 03:48:06.373973 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:06.374189 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:06.374300 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:06.374554 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:06.438588 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:06.498719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:06.498719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:06.498719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:06.498937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:06.498937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:06.500986 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Terminating instance
May 14 03:48:06.908286 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:06.908701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] Acquiring lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:06.908701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:06.908701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:06.908819 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] No waiting events found dispatching network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:06.908920 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-unplugged-7a665605-45a5-4db7-ae03-ff5875248f22 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:06.909445 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Received event network-vif-deleted-7a665605-45a5-4db7-ae03-ff5875248f22 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:06.909584 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Neutron deleted interface 7a665605-45a5-4db7-ae03-ff5875248f22; detaching it from the instance and deleting it from the info cache
May 14 03:48:06.909727 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:07.004566 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:07.042037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.045072 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.066086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.066086 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.089113 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.173121 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:07.184595 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:07.185057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:07.185226 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:07.185356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:07.185465 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] No waiting events found dispatching network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:07.185566 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859dbe40-3000-4783-8d13-4eca6caad3e1 req-2a1ab1f1-78d6-4689-aa13-629a2f642c5f service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:07.339369 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999694065999847 future=<Future at 0x79d0b071d220 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:07.340202 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Instance destroyed successfully.
May 14 03:48:07.340588 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid ec948257-bf93-4a61-9944-d5497f04e2ae {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:07.418001 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fba10c08-67ef-4aae-8913-9e2d58e0aa7f req-f0024767-fa12-425e-824a-142f8672a43a service nova] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Detach interface failed, port_id=7a665605-45a5-4db7-ae03-ff5875248f22, reason: Instance 79f1d098-e1d8-4e10-b9e1-d55dea015415 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:07.675942 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Took 1.30 seconds to deallocate network for instance.
May 14 03:48:07.843278 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-944575287',display_name='tempest-TestVolumeBootPattern-volume-backed-server-944575287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-volume-backed-server-944575287',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExF3qCnAqUnN5QqqvTtM7O204sfCXzZ1r1TrXF31Ah/Ab8uhe/C+XFHF3Y0/RT9zK6R7AYDxjTV/+x14uvhZd7UsuH3q4i0/qeWqwZbfU5Csw0h+aBS2YT81Ce0MbYPJQ==',key_name='tempest-keypair-1909072499',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:15Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-kl0tow2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8406aaa75274bfa842bca7d95576f02',uuid=ec948257-bf93-4a61-9944-d5497f04e2ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:07.843533 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "19c57b10-906a-4e89-853a-abc1119ff5e6", "address": "fa:16:3e:fb:7d:70", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c57b10-90", "ovs_interfaceid": "19c57b10-906a-4e89-853a-abc1119ff5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:07.844246 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:07.844526 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:07.846553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.846778 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19c57b10-90, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:07.847796 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.848817 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:07.849223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.850126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.850295 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1fc9e94-e644-4957-be08-1922b58d49ac) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:07.850791 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.851420 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:07.851740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:07.853783 np0000000741 nova-compute[97948]: INFO os_vif [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7d:70,bridge_name='br-int',has_traffic_filtering=True,id=19c57b10-906a-4e89-853a-abc1119ff5e6,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c57b10-90')
May 14 03:48:07.855229 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:07.855454 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:07.855562 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:07.855883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:07.856103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a185670-7ae8-4ea7-826e-79af80defe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:07.856226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:07.884349 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:07.884769 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:07.884769 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:07.885097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '150')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:07.885812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f', '149')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:07.886555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0905f4220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:07.886773 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdd, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:07.886948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000fee8789f {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:07.939285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:07.984072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:08.024962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:08.025098 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:08.025929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:08.035993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:08.036108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:08.046316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.077574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.40.100,3260]
May 14 03:48:08.077574 np0000000741 nova-compute[97948]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.40.100,3260] successful.
May 14 03:48:08.077574 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.091865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.102417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.131880 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.50.100,3260]
May 14 03:48:08.131880 np0000000741 nova-compute[97948]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-5a185670-7ae8-4ea7-826e-79af80defe6f, portal: 192.168.50.100,3260] successful.
May 14 03:48:08.131880 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.147025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:08.147204 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:08.147305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (291ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:08.147433 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:08.147685 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Deleting instance files /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae_del
May 14 03:48:08.148143 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Deletion of /opt/stack/data/nova/instances/ec948257-bf93-4a61-9944-d5497f04e2ae_del complete
May 14 03:48:08.215631 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Took 0.54 seconds to detach 1 volumes for instance.
May 14 03:48:08.653819 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Took 1.65 seconds to destroy the instance on the hypervisor.
May 14 03:48:08.654452 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:08.654869 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:08.654988 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:08.655271 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:08.720693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:08.721439 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:08.723104 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:08.875927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:09.240830 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:09.241212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] Acquiring lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:09.241212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:09.241355 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:09.241386 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] No waiting events found dispatching network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:09.241499 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-unplugged-19c57b10-906a-4e89-853a-abc1119ff5e6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:09.243427 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Received event network-vif-deleted-19c57b10-906a-4e89-853a-abc1119ff5e6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:09.243427 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Neutron deleted interface 19c57b10-906a-4e89-853a-abc1119ff5e6; detaching it from the instance and deleting it from the info cache
May 14 03:48:09.243427 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:09.289301 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:09.289482 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:09.345897 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:09.346096 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:09.618730 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:09.744712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f381b447-d371-4da7-a80e-d56e45758d2a req-efcfc5af-e2b1-4a41-974f-cd21ec6debd6 service nova] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Detach interface failed, port_id=19c57b10-906a-4e89-853a-abc1119ff5e6, reason: Instance ec948257-bf93-4a61-9944-d5497f04e2ae could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:09.793290 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:09.849194 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'flavor' on Instance uuid 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:10.120524 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Took 1.47 seconds to deallocate network for instance.
May 14 03:48:10.298929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.577s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:10.341032 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance 79f1d098-e1d8-4e10-b9e1-d55dea015415
May 14 03:48:10.660301 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Took 0.54 seconds to detach 1 volumes for instance.
May 14 03:48:10.661945 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Deleting volume: 5a185670-7ae8-4ea7-826e-79af80defe6f {{(pid=97948) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 03:48:10.853414 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:11.198343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:11.198512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:11.351405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-09f3d44d-bdee-4aa5-896a-ff1dc5701e4f tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "79f1d098-e1d8-4e10-b9e1-d55dea015415" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.201s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:11.682821 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:11.683160 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:11.921150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:11.921300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:11.921449 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Attaching volume 11a398b7-64a2-41b1-a734-b00b5c9b4995 to /dev/vdb
May 14 03:48:11.963454 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:11.972693 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:48:11.992242 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:12.050094 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:48:12.050356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:48:12.057890 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:48:12.059269 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fecc:f561', 'fe80::fc16:3eff:fe9a:3cec', 'fe80::34ec:6bff:feb3:d1f', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8'] 
May 14 03:48:12.059367 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:48:12.059476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:48:12.059719 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:12.059962 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating existing volume attachment record: f10c9836-7afb-4ef3-894a-0a3aaed0cd3d {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:48:12.186090 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:12.634709 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '203f4e13-7bd5-4060-92d1-37674b547f4a', 'attached_at': '', 'detached_at': '', 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'serial': '11a398b7-64a2-41b1-a734-b00b5c9b4995'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:48:12.637481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:48:12.637846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:12.637984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:12.638395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:12.638568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:48:12.652017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:12.652704 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:12.653421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:12.653720 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:12.654452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:12.655526 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:12.666352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:12.666352 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:12.671357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:12.671357 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:12.680431 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995] added
May 14 03:48:12.680431 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:12.680431 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:12.680431 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:12.680431 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:12.680431 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:12.680431 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:12.680699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:12.680785 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:12.680923 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:12.684635 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995] added
May 14 03:48:12.684635 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:12.684635 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:12.684635 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:12.684635 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:12.684635 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:12.684635 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:12.684832 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:12.685091 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:12.685240 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:12.693781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.495s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:12.738657 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance ec948257-bf93-4a61-9944-d5497f04e2ae
May 14 03:48:12.851672 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:12.971139 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004154929997639556 future=<Future at 0x79d0905d34a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:12.971139 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:12.971139 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.033529661000102 future=<Future at 0x79d090737500 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:12.971139 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.033459611000126 future=<Future at 0x79d090737500 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:12.973308 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Emitting event <LifecycleEvent: 1778730477.9703703, 8e4d162e-d487-4edc-aac5-e52e0df8a125 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:12.973464 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] VM Stopped (Lifecycle Event)
May 14 03:48:13.477843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 8e4d162e-d487-4edc-aac5-e52e0df8a125] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:13.681435 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:13.685535 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:13.692874 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:13.692874 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:13.699397 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:13.699397 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.705592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.711366 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.717929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.717929 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.717929 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.717929 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.717929 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:13.718218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.718218 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.718218 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.718218 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.718218 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:13.723960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.723960 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.723960 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.723960 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.723960 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:13.724129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.724129 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.724129 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.724129 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.724129 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:13.746565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6e1e7630-4560-4285-82fc-3d20e82ad655 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "ec948257-bf93-4a61-9944-d5497f04e2ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.248s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:13.754960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.40.100,3260]
May 14 03:48:13.754960 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.40.100,3260] successful.
May 14 03:48:13.754960 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.765661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.769981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.50.100,3260]
May 14 03:48:13.769981 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.50.100,3260] successful.
May 14 03:48:13.769981 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.778491 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.778734 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:13.778913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:13.779153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:13.779946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:13.780560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('7', '-', '-', 0) found on session 167 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:13.780766 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.792848 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:13.793067 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:13.793444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:13.793657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:13.794562 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('8', '-', '-', 0) found on session 168 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:13.795117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:13.800887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 167 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:13.800959 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:13.807844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 168 and hctl ['8', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:13.877321 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:14.653009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:14.653493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:14.808275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 168 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:14.808770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:14.922012 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:14.923069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:14.923069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:14.923069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:14.923069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:14.924696 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Terminating instance
May 14 03:48:15.149775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:15.149936 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:15.150397 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Rebooting instance
May 14 03:48:15.156847 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:15.427575 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:15.449157 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:15.451238 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:15.474844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:15.584704 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:15.590391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:15.628480 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:15.628726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:15.629270 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:15.629415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:15.629565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:15.629818 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cf87f3a4-8979-474b-9d59-52c56d40493e req-57eff55b-9de7-409e-81d2-600b55aa1ae8 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:15.676299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Found WWN 3300000003028cd36 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:48:15.678717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:15.678717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000003028cd36', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003028cd36'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:15.678717 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003028cd36', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003028cd36'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:48:15.680887 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:48:15.681115 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:15.681302 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:15.704018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:48:15.704018 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:48:15.704018 np0000000741 nova-compute[97948]:     <volume>11a398b7-64a2-41b1-a734-b00b5c9b4995</volume>
May 14 03:48:15.704018 np0000000741 nova-compute[97948]:   </usage>
May 14 03:48:15.704018 np0000000741 nova-compute[97948]: </secret>
May 14 03:48:15.704018 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:48:15.728058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:15.729119 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'flavor' on Instance uuid 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:15.729346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:15.729687 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:48:15.762052 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999737484999969 future=<Future at 0x79d090629340 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:15.763072 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Instance destroyed successfully.
May 14 03:48:15.763344 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid 608384f9-6f6b-428e-a519-f1631dc5deb2 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:16.169138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:16.232892 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Attempting to attach volume 11a398b7-64a2-41b1-a734-b00b5c9b4995 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:48:16.233870 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:16.236576 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <alias name="ua-11a398b7-64a2-41b1-a734-b00b5c9b4995"/>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <serial>11a398b7-64a2-41b1-a734-b00b5c9b4995</serial>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="c019ac73-a024-4762-b4d8-732d3b636c98"/>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:16.236576 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:48:16.265467 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=55,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-xj5pdi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=608384f9-6f6b-428e-a519-f1631dc5deb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:16.265853 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "address": "fa:16:3e:cc:f5:61", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9133ed-ac", "ovs_interfaceid": "5f9133ed-acb2-4f3e-b080-6e9b9aaea794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:16.266390 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:16.266705 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:16.268421 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.269694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9133ed-ac, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:16.271040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.271040 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:16.272603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.273595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.273876 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61c0053e-84b4-4907-af3e-e81715edd519) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:16.274496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.275181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:16.277371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:16.279625 np0000000741 nova-compute[97948]: INFO os_vif [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f5:61,bridge_name='br-int',has_traffic_filtering=True,id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9133ed-ac')
May 14 03:48:16.280115 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Deleting instance files /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_del
May 14 03:48:16.290325 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Deletion of /opt/stack/data/nova/instances/608384f9-6f6b-428e-a519-f1631dc5deb2_del complete
May 14 03:48:16.588983 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:16.716973 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:16.798079 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:48:16.798655 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:16.801667 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:16.801667 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:16.801667 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:16.874762 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:17.222406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:17.250174 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:17.250299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:17.252660 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Attaching volume bfef92fa-b951-47a6-8faa-cfb8a77f9f06 to /dev/vdb
May 14 03:48:17.431335 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5796001b-82f1-412b-a742-ad1239174b4e req-7a64a4ab-4559-4c07-9ab2-4793d4734067 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-deleted-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:17.433195 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-5796001b-82f1-412b-a742-ad1239174b4e req-7a64a4ab-4559-4c07-9ab2-4793d4734067 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Neutron deleted interface 5f9133ed-acb2-4f3e-b080-6e9b9aaea794; detaching it from the instance and deleting it from the info cache
May 14 03:48:17.433371 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-5796001b-82f1-412b-a742-ad1239174b4e req-7a64a4ab-4559-4c07-9ab2-4793d4734067 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:17.471213 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:17.481808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:48:17.505150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:17.552064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:48:17.552489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:48:17.562373 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:48:17.563733 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fe9a:3cec', 'fe80::34ec:6bff:feb3:d1f', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425', 'fe80::fc16:3eff:fe1c:30f8'] 
May 14 03:48:17.563849 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:48:17.563969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:48:17.564179 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:17.564455 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updating existing volume attachment record: 59d7d705-b7fd-44ab-b187-237ee9a67a3b {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:48:17.683124 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:17.683586 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] Acquiring lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:17.683765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:17.683878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:17.683975 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] No waiting events found dispatching network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:17.684082 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5088d281-29b3-4ae3-8099-0b0a5d718353 req-2a2dff8d-8fb1-4184-9280-96809ecf6e1f service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Received event network-vif-unplugged-5f9133ed-acb2-4f3e-b080-6e9b9aaea794 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:17.726669 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:17.740417 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:17.939754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5796001b-82f1-412b-a742-ad1239174b4e req-7a64a4ab-4559-4c07-9ab2-4793d4734067 service nova] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Detach interface failed, port_id=5f9133ed-acb2-4f3e-b080-6e9b9aaea794, reason: Instance 608384f9-6f6b-428e-a519-f1631dc5deb2 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:18.135744 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'serial': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:48:18.138648 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:48:18.138967 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:18.139175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:18.139600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:18.139799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:48:18.150886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:18.151606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:18.152331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:18.152331 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:18.152577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:18.153017 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:18.163514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:18.163514 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:18.169686 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:18.169686 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:18.177669 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06] added
May 14 03:48:18.177669 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:18.177669 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:18.177669 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:18.177669 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:18.177669 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:18.177669 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:18.177955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:18.177955 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:18.178153 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:18.181752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06] added
May 14 03:48:18.181752 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:18.181752 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:18.181752 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:18.181752 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:18.181752 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:18.181752 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:18.181958 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:18.182082 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:18.182194 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:18.242208 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Took 1.44 seconds to deallocate network for instance.
May 14 03:48:18.747725 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:18.747931 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:18.879911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:18.938654 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:18.938804 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:18.938844 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:18.938946 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No VIF found with MAC fa:16:3e:9a:3c:ec, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:19.031745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:19.031883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:19.178709 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:19.182575 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:19.192591 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:19.192591 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:19.196612 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:19.196612 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.207365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.212281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.224003 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.224467 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.229690 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.229988 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:19.235756 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:19.236005 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:19.273382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.40.100,3260]
May 14 03:48:19.273382 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.40.100,3260] successful.
May 14 03:48:19.273382 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.277841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.50.100,3260]
May 14 03:48:19.277841 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.50.100,3260] successful.
May 14 03:48:19.277841 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.284227 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.290458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.300443 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.300788 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:19.300956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:19.301014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:19.301885 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('9', '-', '-', 0) found on session 169 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:19.301994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.307323 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:19.307591 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:19.307781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:19.307781 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:19.308828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('12', '-', '-', 0) found on session 170 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:19.308910 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:19.315284 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 169 and hctl ['9', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:19.323039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 170 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:19.323039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:19.533996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:48:19.738495 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:20.005122 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00040007400002650684 future=<Future at 0x79d090737500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:20.005951 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730485.0045514, 79f1d098-e1d8-4e10-b9e1-d55dea015415 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:20.005951 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:20.005951 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] VM Stopped (Lifecycle Event)
May 14 03:48:20.007067 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.3320821659999638 future=<Future at 0x79d0b071d220 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:20.007067 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.3319601910002348 future=<Future at 0x79d0b071d220 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:20.086602 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:20.245766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.498s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:20.247930 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.160s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:20.251531 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:48:20.251678 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Claim successful on node np0000000741
May 14 03:48:20.306970 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance 608384f9-6f6b-428e-a519-f1631dc5deb2
May 14 03:48:20.316414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 169 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:20.316702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:20.487971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-2e50c20d-917c-44a5-8674-a5bd6b276dae tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.567s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:20.508479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-321f1704-9afc-49f7-bf8d-1a7ecb62ef1b tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 79f1d098-e1d8-4e10-b9e1-d55dea015415] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:20.830668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:20.830808 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:21.164432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.169775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.186567 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found WWN 33000000008df1d2a for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:48:21.186868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:21.189286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.189286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.196990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '33000000008df1d2a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000008df1d2a'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:21.196990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000008df1d2a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000008df1d2a'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:48:21.196990 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:48:21.196990 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:21.196990 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:21.214633 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.216905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.217850 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.luks [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 03:48:21.218152 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:48:21.218304 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:21.218435 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:48:21.222205 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x79d0b8183f80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'serial': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:48:21.222355 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] formatting encrypted volume /dev/dm-1 {{(pid=97948) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 03:48:21.275124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.307440 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:21.307872 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:21.307984 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:21.308085 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:21.308202 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:21.308592 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0c63b4c9-c42d-46b3-8963-d425d3ed32fa req-a8822474-0e32-4c49-8d66-02f61c6ff283 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received unexpected event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with vm_state active and task_state reboot_started.
May 14 03:48:21.318229 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-f2a3e9aa-bbaa-4c78-8209-5bef0deb35ed tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "608384f9-6f6b-428e-a519-f1631dc5deb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.396s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:21.332978 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Detaching volume 11a398b7-64a2-41b1-a734-b00b5c9b4995
May 14 03:48:21.385385 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Attempting to driver detach volume 11a398b7-64a2-41b1-a734-b00b5c9b4995 from mountpoint /dev/vdb
May 14 03:48:21.428545 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '203f4e13-7bd5-4060-92d1-37674b547f4a', 'attached_at': '', 'detached_at': '', 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'serial': '11a398b7-64a2-41b1-a734-b00b5c9b4995'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:48:21.432954 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Found disk vdb by alias ua-11a398b7-64a2-41b1-a734-b00b5c9b4995 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:21.434529 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Found disk vdb by alias ua-11a398b7-64a2-41b1-a734-b00b5c9b4995 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:21.434688 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Attempting to detach device vdb from instance 203f4e13-7bd5-4060-92d1-37674b547f4a from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:48:21.435364 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <alias name="ua-11a398b7-64a2-41b1-a734-b00b5c9b4995"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <serial>11a398b7-64a2-41b1-a734-b00b5c9b4995</serial>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="c019ac73-a024-4762-b4d8-732d3b636c98"/>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:21.435364 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:21.442305 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully detached device vdb from instance 203f4e13-7bd5-4060-92d1-37674b547f4a from the persistent domain config.
May 14 03:48:21.442621 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] (1/8): Attempting to detach device vdb with device alias ua-11a398b7-64a2-41b1-a734-b00b5c9b4995 from instance 203f4e13-7bd5-4060-92d1-37674b547f4a from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:48:21.442989 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <alias name="ua-11a398b7-64a2-41b1-a734-b00b5c9b4995"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <serial>11a398b7-64a2-41b1-a734-b00b5c9b4995</serial>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="c019ac73-a024-4762-b4d8-732d3b636c98"/>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:21.442989 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:21.456895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.470918 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:21.491815 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998970121000184 future=<Future at 0x79d0b84c97c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:21.752053 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance shutdown successfully.
May 14 03:48:21.774343 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:21.774566 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:22.066083 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-11a398b7-64a2-41b1-a734-b00b5c9b4995 for instance 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:48:22.067923 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730502.0677092, 203f4e13-7bd5-4060-92d1-37674b547f4a => ua-11a398b7-64a2-41b1-a734-b00b5c9b4995> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:48:22.070314 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully detached device vdb from instance 203f4e13-7bd5-4060-92d1-37674b547f4a from the live domain config.
May 14 03:48:22.072864 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:22.073112 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:22.073285 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:22.073593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:22.074057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a398b7-64a2-41b1-a734-b00b5c9b4995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:22.074209 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:22.101565 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:22.101851 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:22.102249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '170')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:22.102428 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '167')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:22.103561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995', '168')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:22.104591 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c0720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:22.104872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:22.105173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flush multipath device 3300000003028cd36 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:22.129937 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:22.130060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:22.130178 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:22.130282 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:22.130426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:22.132137 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Terminating instance
May 14 03:48:22.143888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:22.182995 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:22.232828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:22.233044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:22.234314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:22.247494 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:22.247788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:22.259667 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.285449 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:22.291018 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.305800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.40.100,3260]
May 14 03:48:22.305800 np0000000741 nova-compute[97948]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.40.100,3260] successful.
May 14 03:48:22.305800 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.314026 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.331453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.340763 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000430086000051233 future=<Future at 0x79d0b071d220 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:22.340763 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:22.340763 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.422043624000253 future=<Future at 0x79d090629340 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:22.340763 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.421948488999988 future=<Future at 0x79d090629340 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:22.341280 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730487.3389606, ec948257-bf93-4a61-9944-d5497f04e2ae => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:22.341489 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] VM Stopped (Lifecycle Event)
May 14 03:48:22.343269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.387224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.50.100,3260]
May 14 03:48:22.387224 np0000000741 nova-compute[97948]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-11a398b7-64a2-41b1-a734-b00b5c9b4995, portal: 192.168.50.100,3260] successful.
May 14 03:48:22.387224 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.407901 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.416785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:22.416785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:22.416785 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== disconnect_volume: return (341ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:22.416785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:22.591911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.592339 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.594522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.618108 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.634716 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:22.660453 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.663236 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.685365 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.795191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.549s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:22.796400 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:48:22.815740 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.821629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:22.825871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:22.826053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:22.826205 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:22.826321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:22.826421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:22.826536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-19a90b1f-03d2-4d34-8017-6b41eeb6a454 req-390ab631-cff3-44f5-a454-f2a1db8791ea service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:22.844530 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: ec948257-bf93-4a61-9944-d5497f04e2ae] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:22.972544 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'flavor' on Instance uuid 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:22.974620 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999752211999748 future=<Future at 0x79d0906088c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:22.977825 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Instance destroyed successfully.
May 14 03:48:22.978446 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid a2050a6c-1c7b-4454-8a7e-14960f06b79b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:23.153136 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Removed pending STOPPED event for c855e972-ae69-4b13-9b2f-6a588dbc3364 due to new event <LifecycleEvent: 1778730503.151483, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Resumed> {{(pid=97948) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 03:48:23.155105 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730503.151483, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:23.155105 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Resumed (Lifecycle Event)
May 14 03:48:23.157406 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance running successfully.
May 14 03:48:23.157686 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance soft rebooted successfully.
May 14 03:48:23.158084 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:23.302300 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:48:23.303246 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:48:23.303907 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:23.304140 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:23.381377 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:23.381853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:23.381853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:23.381993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:23.382188 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:23.382330 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received unexpected event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with vm_state active and task_state None.
May 14 03:48:23.382504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:23.382702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:23.383053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:23.383053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:23.383730 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:23.384618 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received unexpected event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with vm_state active and task_state None.
May 14 03:48:23.384618 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:23.384738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:23.385078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:23.385078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:23.385285 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:23.385383 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-5c109f03-e949-423e-80f6-749d5465a22b req-873deaba-0960-4a18-b487-f2591aee7dd1 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received unexpected event network-vif-plugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with vm_state active and task_state None.
May 14 03:48:23.389134 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:48:23.481795 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=54,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:02Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-76tfvim5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=a2050a6c-1c7b-4454-8a7e-14960f06b79b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:23.482127 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "address": "fa:16:3e:1c:30:f8", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f3126-9e", "ovs_interfaceid": "4b5f3126-9e98-4485-b87a-b6a8cee76119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:23.483739 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:23.484450 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:23.487085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:23.487085 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b5f3126-9e, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:23.489752 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:23.493141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:23.493141 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddbc268c-620f-4238-9408-3eeb71cc0a75) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:23.494101 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:23.494652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:23.496355 np0000000741 nova-compute[97948]: INFO os_vif [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f3126-9e98-4485-b87a-b6a8cee76119,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f3126-9e')
May 14 03:48:23.496653 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Deleting instance files /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_del
May 14 03:48:23.504468 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Deletion of /opt/stack/data/nova/instances/a2050a6c-1c7b-4454-8a7e-14960f06b79b_del complete
May 14 03:48:23.658277 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:23.659906 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:23.665038 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-34ab8e08-e550-478c-81a4-e76649294eab tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.515s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:23.783562 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:23.784112 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:23.803311 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:48:23.868248 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Successfully created port: 92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:48:23.882369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:23.980594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9ad5c9c4-fc8f-4a91-9e45-aeb0a1c73c2b tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.150s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:24.010871 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 03:48:24.011393 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:24.011629 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:24.011736 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:24.011955 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:24.133792 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:24.135153 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:24.135370 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:24.135659 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:24.135914 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:24.136072 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:24.138636 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Terminating instance
May 14 03:48:24.163998 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730504.162358, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:24.163998 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Started (Lifecycle Event)
May 14 03:48:24.308154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:48:24.412936 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Successfully updated port: 92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:48:24.463094 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-changed-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:24.463280 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Refreshing instance network info cache due to event network-changed-92068630-02d8-4706-aaa7-f5109f99c04d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:24.463460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] Acquiring lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:24.463573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] Acquired lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:24.463734 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Refreshing network info cache for port 92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:24.645622 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:24.664305 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.672211 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:24.672211 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.678919 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:24.688984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.694165 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.709378 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.715813 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.778080 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:24.778080 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:24.815542 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Booting with volume 53aefc7f-07a2-4196-9807-3e01796cb61c at /dev/vda
May 14 03:48:24.864780 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:24.875957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:24.877558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:48:24.892738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:24.892738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Acquiring lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:24.892738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:24.892738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:24.892738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] No waiting events found dispatching network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:24.893172 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-unplugged-4b5f3126-9e98-4485-b87a-b6a8cee76119 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:24.893172 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Received event network-vif-deleted-4b5f3126-9e98-4485-b87a-b6a8cee76119 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:24.893172 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Neutron deleted interface 4b5f3126-9e98-4485-b87a-b6a8cee76119; detaching it from the instance and deleting it from the info cache
May 14 03:48:24.893340 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:24.909054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:24.925701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:24.953492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.956237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:48:24.956516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:48:24.961788 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:24.965911 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:24.969840 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:48:24.971272 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2', 'fe80::fc16:3eff:feb7:3425'] 
May 14 03:48:24.971846 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:48:24.973368 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:48:24.973368 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:24.973368 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating existing volume attachment record: a8879c58-5cc5-44c6-b895-0d13184674d3 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:48:24.984502 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Instance destroyed successfully.
May 14 03:48:24.985990 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'resources' on Instance uuid 203f4e13-7bd5-4060-92d1-37674b547f4a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:25.029079 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:48:25.177010 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:25.182443 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999663229999896 future=<Future at 0x79d0b0217590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:25.357236 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:48:25.357236 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:48:25.357236 np0000000741 nova-compute[97948]:     <volume>bfef92fa-b951-47a6-8faa-cfb8a77f9f06</volume>
May 14 03:48:25.357236 np0000000741 nova-compute[97948]:   </usage>
May 14 03:48:25.357236 np0000000741 nova-compute[97948]: </secret>
May 14 03:48:25.357236 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:48:25.364178 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:25.378753 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Took 1.37 seconds to deallocate network for instance.
May 14 03:48:25.397525 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Detach interface failed, port_id=4b5f3126-9e98-4485-b87a-b6a8cee76119, reason: Instance a2050a6c-1c7b-4454-8a7e-14960f06b79b could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:25.397686 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:25.397912 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:25.398266 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:25.398405 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:25.398548 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] No waiting events found dispatching network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:25.398690 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e6da718f-328a-4e0c-a7ed-5a438a0b73c2 req-739f1505-a319-4a44-9cfa-002498f666e6 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:25.487574 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-37528970',display_name='tempest-TestEncryptedCinderVolumes-server-37528970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-37528970',id=63,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJkWLoBNj/3MZEFWkaOllptqAI+iuXQ6MEJFhysjenLvuFm7NQ9x7ZQbENYc652IIc89Lp7Th9ucRxZYDpVPz3ZTtfatzb61kO1qUwIxHECsDq9suqpMl2BAB6X0rY2Gw==',key_name='tempest-keypair-479848232',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:30Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-0oc17s5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=203f4e13-7bd5-4060-92d1-37674b547f4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:25.489721 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "address": "fa:16:3e:9a:3c:ec", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap093527f6-49", "ovs_interfaceid": "093527f6-49e0-45f0-b1c6-d36d937e7d5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:25.489721 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:25.489721 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:25.492785 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:25.493030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap093527f6-49, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:25.497692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:25.499556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:25.499720 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e46b0c69-1ee2-4d17-9c0e-6a3137d9b8d0) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:25.502014 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:25.507816 np0000000741 nova-compute[97948]: INFO os_vif [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:3c:ec,bridge_name='br-int',has_traffic_filtering=True,id=093527f6-49e0-45f0-b1c6-d36d937e7d5d,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093527f6-49')
May 14 03:48:25.507816 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Deleting instance files /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a_del
May 14 03:48:25.507816 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Deletion of /opt/stack/data/nova/instances/203f4e13-7bd5-4060-92d1-37674b547f4a_del complete
May 14 03:48:25.678973 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7a4bb9ab-6943-4e74-a81b-0cdb4fcba9f5 req-c15a609e-6cde-418f-a6cc-46c3336b9284 service nova] Releasing lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:25.679430 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:25.679619 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:48:25.783292 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:25.783646 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:25.866263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Attempting to attach volume bfef92fa-b951-47a6-8faa-cfb8a77f9f06 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:48:25.868062 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <alias name="ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06"/>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <serial>bfef92fa-b951-47a6-8faa-cfb8a77f9f06</serial>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="839a2454-559f-42c6-b239-708684ab10ab"/>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:25.868062 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:48:25.885675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:25.886009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:26.013708 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 03:48:26.014434 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:26.014813 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:26.014959 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:26.015197 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:26.145564 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:26.259327 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:48:26.463143 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:26.480562 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:26.480778 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:26.639876 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating instance_info_cache with network_info: [{"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:26.690325 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2dae6885-0900-4a12-ad6b-7888749e9b06 req-f5d7db5e-0cfa-4cb0-a9e7-746f347e1624 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-deleted-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:26.690471 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-2dae6885-0900-4a12-ad6b-7888749e9b06 req-f5d7db5e-0cfa-4cb0-a9e7-746f347e1624 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Neutron deleted interface 093527f6-49e0-45f0-b1c6-d36d937e7d5d; detaching it from the instance and deleting it from the info cache
May 14 03:48:26.690580 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2dae6885-0900-4a12-ad6b-7888749e9b06 req-f5d7db5e-0cfa-4cb0-a9e7-746f347e1624 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:26.956064 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:26.958651 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] Acquiring lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:26.958845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:26.959013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:26.959212 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] No waiting events found dispatching network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:26.959360 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8892e205-02b5-4753-8304-bd001aa220bb req-5e9cb209-a539-4eb5-9dc0-fad364361bb3 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Received event network-vif-unplugged-093527f6-49e0-45f0-b1c6-d36d937e7d5d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:26.983159 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:27.098717 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:48:27.099585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:48:27.099802 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Creating image(s)
May 14 03:48:27.100095 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:48:27.100211 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Ensure instance console log exists: /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:48:27.100421 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:27.100556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:27.100675 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:27.105862 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:27.142886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:27.143250 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance network_info: |[{"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:48:27.144027 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Start _get_guest_xml network_info=[{"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c91d7618-3b0d-4cdd-94b4-61424a502c3f', 'attached_at': '', 'detached_at': '', 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'serial': '53aefc7f-07a2-4196-9807-3e01796cb61c'}, 'boot_index': 0, 'attachment_id': 'a8879c58-5cc5-44c6-b895-0d13184674d3', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:48:27.146356 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:48:27.147338 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-20490568', uuid='c91d7618-3b0d-4cdd-94b4-61424a502c3f'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730507.1470482) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:48:27.148354 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:48:27.148676 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:48:27.149633 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:48:27.149785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:48:27.150704 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:48:27.150945 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:48:27.151062 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:48:27.151144 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:48:27.151295 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:48:27.151445 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:48:27.151445 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:48:27.151556 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:48:27.151656 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:48:27.151762 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:48:27.151858 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:48:27.151964 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:48:27.160539 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:48:27.160834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:27.160954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:27.161252 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:27.161438 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:48:27.172582 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:27.173248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:27.173812 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:27.173962 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:27.174280 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:27.174444 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:27.185621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:27.185621 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:27.189957 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:27.189957 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:27.198752 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2dae6885-0900-4a12-ad6b-7888749e9b06 req-f5d7db5e-0cfa-4cb0-a9e7-746f347e1624 service nova] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Detach interface failed, port_id=093527f6-49e0-45f0-b1c6-d36d937e7d5d, reason: Instance 203f4e13-7bd5-4060-92d1-37674b547f4a could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:27.199981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c] added
May 14 03:48:27.199981 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:27.199981 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:27.199981 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:27.199981 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:27.199981 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:27.199981 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:27.200269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:27.200269 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:27.200680 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:27.205855 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c] added
May 14 03:48:27.205855 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:27.205855 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:27.205855 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:27.205855 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:27.205855 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:27.205855 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:27.206129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:27.206129 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:27.206238 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:27.490055 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.604s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:27.550265 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance a2050a6c-1c7b-4454-8a7e-14960f06b79b
May 14 03:48:27.607874 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Took 1.59 seconds to deallocate network for instance.
May 14 03:48:27.783183 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:27.783836 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:28.112925 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:28.113057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:28.200841 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:28.206580 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:28.213613 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:28.213613 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:28.220413 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:28.220413 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.227171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.232175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.244315 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.244589 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.252658 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:28.285663 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260]
May 14 03:48:28.285663 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260] successful.
May 14 03:48:28.285663 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.294819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.295314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260]
May 14 03:48:28.295314 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260] successful.
May 14 03:48:28.295314 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.305705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.315854 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.316608 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:28.316608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:28.317281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('7', '-', '-', 0) found on session 171 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:28.317396 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:28.330426 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:28.332163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 171 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:28.332163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:28.332163 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:28.332436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:28.333355 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('8', '-', '-', 0) found on session 172 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:28.333512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:28.348854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 172 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:28.348854 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:28.461337 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:28.461540 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:28.461754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:28.461937 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:f7:9d:a2, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:28.559401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-25b0ab51-c6e7-48eb-9a2d-3725ec41d8da tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "a2050a6c-1c7b-4454-8a7e-14960f06b79b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.429s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:28.593043 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:28.593337 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:28.883878 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:28.981304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:28.981579 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:29.095838 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:29.174510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:48:29.485083 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:29.602299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.489s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:29.661753 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deleted allocations for instance 203f4e13-7bd5-4060-92d1-37674b547f4a
May 14 03:48:30.020579 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ec9247bb-a7d7-487f-a784-39f41259cd04 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.770s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:30.189662 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000afbfdd02 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:48:30.189889 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:30.190041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000afbfdd02', 'path': '/dev/dm-0', 'multipath_id': '330000000afbfdd02'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:30.190152 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000afbfdd02', 'path': '/dev/dm-0', 'multipath_id': '330000000afbfdd02'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:48:30.312772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:30.312898 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:30.371493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:30.371695 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:30.371890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:30.372036 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:30.372168 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:30.374145 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Terminating instance
May 14 03:48:30.489320 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:30.500293 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:30.669442 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-4db415fb-8d6b-4cce-921a-190e4d98d006 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "203f4e13-7bd5-4060-92d1-37674b547f4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.534s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:30.694758 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-20490568',display_name='tempest-TestVolumeBootPattern-server-20490568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-20490568',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-9ighn21w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:24Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=c91d7618-3b0d-4cdd-94b4-61424a502c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:48:30.694921 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:30.695356 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:30.696396 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid c91d7618-3b0d-4cdd-94b4-61424a502c3f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:30.762296 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00036018699984197156 future=<Future at 0x79d090629340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762401 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762475 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.728258420000202 future=<Future at 0x79d0b84c97c0 state=cancelled>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762541 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=5.728180756000256 future=<Future at 0x79d0b84c97c0 state=cancelled>) was cancelled while queued, skipping {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762598 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762690 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.211624532999849 future=<Future at 0x79d0906088c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762762 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.211550506000094 future=<Future at 0x79d0906088c0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:30.762941 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Emitting event <LifecycleEvent: 1778730495.7616987, 608384f9-6f6b-428e-a519-f1631dc5deb2 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:30.763101 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] VM Stopped (Lifecycle Event)
May 14 03:48:30.783192 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:30.783397 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:48:30.783612 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:30.815067 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Detaching volume bfef92fa-b951-47a6-8faa-cfb8a77f9f06
May 14 03:48:30.857607 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Attempting to driver detach volume bfef92fa-b951-47a6-8faa-cfb8a77f9f06 from mountpoint /dev/vdb
May 14 03:48:30.878465 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:30.884294 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'serial': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:48:30.891220 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:30.892487 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:30.892594 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Attempting to detach device vdb from instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:48:30.892851 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <alias name="ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <serial>bfef92fa-b951-47a6-8faa-cfb8a77f9f06</serial>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="839a2454-559f-42c6-b239-708684ab10ab"/>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:30.892851 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:30.897334 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:30.903141 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 from the persistent domain config.
May 14 03:48:30.903252 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] (1/8): Attempting to detach device vdb with device alias ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 from instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:48:30.903786 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <alias name="ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <serial>bfef92fa-b951-47a6-8faa-cfb8a77f9f06</serial>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="839a2454-559f-42c6-b239-708684ab10ab"/>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:30.903786 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:30.904913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:30.923286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.043947 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.051481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.183797 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.190091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.198765 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] End _get_guest_xml xml=<domain type="qemu">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <uuid>c91d7618-3b0d-4cdd-94b4-61424a502c3f</uuid>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <name>instance-00000044</name>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-20490568</nova:name>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:48:27</nova:creationTime>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         <nova:port uuid="92068630-02d8-4706-aaa7-f5109f99c04d">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <system>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="serial">c91d7618-3b0d-4cdd-94b4-61424a502c3f</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="uuid">c91d7618-3b0d-4cdd-94b4-61424a502c3f</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </system>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <os>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </os>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <features>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </features>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   <devices>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/disk.config"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </disk>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <alias name="ua-53aefc7f-07a2-4196-9807-3e01796cb61c"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <serial>53aefc7f-07a2-4196-9807-3e01796cb61c</serial>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </disk>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:79:1d:6e"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <target dev="tap92068630-02"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </interface>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/console.log" append="off"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </serial>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <video>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </video>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </rng>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:   </devices>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]: </domain>
May 14 03:48:31.198765 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Preparing to wait for external event network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-20490568',display_name='tempest-TestVolumeBootPattern-server-20490568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-20490568',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-9ighn21w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:24Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=c91d7618-3b0d-4cdd-94b4-61424a502c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:31.201238 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:31.201560 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:48:31.203044 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.203258 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.203456 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:48:31.205369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.205369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a64ce8b8-4379-5766-9350-7e9129cefc83', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.207595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:31.214035 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.215736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.215914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92068630-02, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.216309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92068630-02, col_values=(('qos', UUID('e50e797e-948e-4fcb-afec-de091881ddd4')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.216483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92068630-02, col_values=(('external_ids', {'iface-id': '92068630-02d8-4706-aaa7-f5109f99c04d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:1d:6e', 'vm-uuid': 'c91d7618-3b0d-4cdd-94b4-61424a502c3f'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.220587 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:31.221838 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999785734999932 future=<Future at 0x79d0b84e6300 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:31.224646 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Instance destroyed successfully.
May 14 03:48:31.225159 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid 85c0d018-04a6-4eeb-94c7-73c7077c43f1 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:31.231218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.232567 np0000000741 nova-compute[97948]: INFO os_vif [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02')
May 14 03:48:31.265215 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 608384f9-6f6b-428e-a519-f1631dc5deb2] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:31.451882 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730511.4514997, 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 => ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:48:31.452425 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 for instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:48:31.454455 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 from the live domain config.
May 14 03:48:31.456838 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:31.457129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:31.457282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:31.457616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:31.457952 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:31.458135 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06 (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:31.492151 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:31.492763 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:31.492763 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '169')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:31.493682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06', '170')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:31.497472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c16c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:31.497472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Removing multipathed devices sdd, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:31.497859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flush multipath device 33000000008df1d2a {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:31.535875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:31.583088 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:31.583246 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:31.583378 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:31.583556 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:31.583556 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] No waiting events found dispatching network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:31.583718 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7086a99c-6f47-4512-90a7-37ae1a69bd10 req-67a7fc89-bca6-4152-afec-91cbbbbf66d0 service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:31.593149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:31.593401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:31.593847 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Attaching volume 18079a50-eaee-43d2-99fc-10b86392ee1a to /dev/vdb
May 14 03:48:31.594487 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:31.639990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:31.640136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:31.641222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:31.643039 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:31.655697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:31.655822 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:31.657171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:48:31.668348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.685204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:31.705137 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.40.100,3260]
May 14 03:48:31.705137 np0000000741 nova-compute[97948]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.40.100,3260] successful.
May 14 03:48:31.705137 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.724932 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.730415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-1',id=51,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:58Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-cg7h00ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=85c0d018-04a6-4eeb-94c7-73c7077c43f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:31.730821 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "address": "fa:16:3e:b7:34:25", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap697d1fb0-c4", "ovs_interfaceid": "697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:31.732027 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:31.732650 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:31.736370 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.737078 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.737658 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap697d1fb0-c4, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.741924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:31.745911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.747019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.747200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a48e8c0-8bdf-47bb-acd6-0c6cd81389dc) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:31.749318 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:48:31.750370 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:31.750621 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:48:31.753482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:31.755595 np0000000741 nova-compute[97948]: INFO os_vif [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:34:25,bridge_name='br-int',has_traffic_filtering=True,id=697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697d1fb0-c4')
May 14 03:48:31.755913 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Deleting instance files /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1_del
May 14 03:48:31.756609 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Deletion of /opt/stack/data/nova/instances/85c0d018-04a6-4eeb-94c7-73c7077c43f1_del complete
May 14 03:48:31.759326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:48:31.760870 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5d:fa18', 'fe80::e837:dfff:fecd:fa7d', 'fe80::fc16:3eff:fef7:9da2', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fe8d:422e', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fec1:d744', 'fe80::d091:8dff:fe12:75d5', 'fe80::fc16:3eff:fe92:e4d2'] 
May 14 03:48:31.761034 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:48:31.761394 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:48:31.761840 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:31.762068 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating existing volume attachment record: c2e0f822-0ec8-4cd0-9d64-c55322620c69 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:48:31.769548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.50.100,3260]
May 14 03:48:31.769548 np0000000741 nova-compute[97948]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-bfef92fa-b951-47a6-8faa-cfb8a77f9f06, portal: 192.168.50.100,3260] successful.
May 14 03:48:31.769548 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.783269 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:31.785049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:31.786073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:31.786245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== disconnect_volume: return (328ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:31.786444 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:32.267771 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:48:32.271051 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:32.271990 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:32.271990 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:32.271990 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:32.291254 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:32.291755 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:32.291899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:32.292024 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:48:32.321534 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:48:32.321534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:32.321534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:32.321534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:32.321534 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:48:32.336098 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:32.336555 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:32.336793 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:32.339028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:32.339445 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:32.339603 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:32.346860 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:32.350504 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:32.354171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:32.354171 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:32.356019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:32.356019 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:32.367430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a] added
May 14 03:48:32.367430 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:32.367430 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:32.367430 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:32.367430 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:32.367430 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:32.367430 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:32.367845 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:32.368039 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:32.368168 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:32.373029 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a] added
May 14 03:48:32.373029 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:32.373029 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:32.373029 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:32.373029 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:32.373029 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:32.373029 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:32.373197 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:32.373388 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:32.373574 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:32.752397 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:32.752494 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:32.752596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:79:1d:6e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:32.752979 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Using config drive
May 14 03:48:33.110377 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:33.260336 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:33.328115 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.360791 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-e950d2b8-bde9-4a69-bc99-fbe9771543e8 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.047s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:33.369372 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:33.374021 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:33.385869 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:33.385869 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:33.391848 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:33.391848 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.404956 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Creating config drive at /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/disk.config
May 14 03:48:33.405405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.409509 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplipxzs0l {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.422911 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.423875 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.424123 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:33.429481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.431097 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.445379 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.445914 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:33.466560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.40.100,3260]
May 14 03:48:33.466560 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.40.100,3260] successful.
May 14 03:48:33.466560 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.480406 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.482191 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplipxzs0l" returned: 0 in 0.074s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.496070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.50.100,3260]
May 14 03:48:33.496070 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.50.100,3260] successful.
May 14 03:48:33.496070 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.496549 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.496872 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:33.497161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:33.497260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:33.498105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] HCTL ('9', '-', '-', 0) found on session 173 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:33.498190 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:33.512912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:33.522861 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching for a device in session 173 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:33.523587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.530884 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:33.531574 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:33.531574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:33.532332 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] HCTL ('12', '-', '-', 0) found on session 174 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:33.532444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:33.534543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.537925 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.553456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Searching for a device in session 174 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:33.553703 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:33.569121 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:33.569432 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:33.569716 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:33.569886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:33.570027 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:33.574819 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Terminating instance
May 14 03:48:33.612474 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Took 1.34 seconds to deallocate network for instance.
May 14 03:48:33.674803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.677810 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.704772 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:33.705493 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] Acquiring lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:33.705845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:33.706315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:33.706631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] No waiting events found dispatching network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:33.706872 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received unexpected event network-vif-unplugged-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 for instance with vm_state deleted and task_state None.
May 14 03:48:33.707013 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12952e3d-ef77-4dec-8ccb-53e95507e318 req-3dfb2082-ff90-4833-a9db-27e05d717c0b service nova] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Received event network-vif-deleted-697d1fb0-c4cf-40aa-a1a0-8af046a4c9f6 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:33.787954 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.795758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.890022 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:33.925718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:33.926913 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:33.950659 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:33.968959 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.053531 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.063112 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:34.083826 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.084120 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:34.115187 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.118556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.123106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:34.124062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:34.145983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.172003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.172479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:34.205481 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d50c111d-8d4c-459b-b8dd-7ab21678305e req-e91db48a-7232-4ac5-aae8-d27607a199fb service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:34.209427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d50c111d-8d4c-459b-b8dd-7ab21678305e req-e91db48a-7232-4ac5-aae8-d27607a199fb service nova] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:34.210701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d50c111d-8d4c-459b-b8dd-7ab21678305e req-e91db48a-7232-4ac5-aae8-d27607a199fb service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:34.210701 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d50c111d-8d4c-459b-b8dd-7ab21678305e req-e91db48a-7232-4ac5-aae8-d27607a199fb service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:34.210701 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d50c111d-8d4c-459b-b8dd-7ab21678305e req-e91db48a-7232-4ac5-aae8-d27607a199fb service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Processing event network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:48:34.301561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.302082 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:48:34.329256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.336970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.340356 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:48:34.350306 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.368798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.376470 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.456097 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99935492099985 future=<Future at 0x79d0b81a35f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:34.460202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:34.487429 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Instance destroyed successfully.
May 14 03:48:34.489750 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'resources' on Instance uuid 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:34.507332 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.534566 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:34.580661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.580661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:34.694862 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.702542 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:48:34.704924 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:48:34.708225 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:34.708397 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:34.711198 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:48:34.712118 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:34.757310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:34.757657 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=12132MB free_disk=72.62109756469727GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:48:34.759704 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:34.945733 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730514.9452443, c91d7618-3b0d-4cdd-94b4-61424a502c3f => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:34.945970 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] VM Started (Lifecycle Event)
May 14 03:48:34.948094 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:48:34.950911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:48:34.954999 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance spawned successfully.
May 14 03:48:34.955468 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:48:35.000321 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1898993263',display_name='tempest-TestEncryptedCinderVolumes-server-1898993263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1898993263',id=64,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXRUeu9bClYl1krF2P7CLvpC+DYYJmR/Ovyhmv43GOLnCr/iqVXtH9/GPqLKFFtQzXQVTQn7gpVOmoOCtJ9VWv3PZt0Ohd4fFF7dgdCMhEeMHMA/Z8JNMoLtfo5Ka/q0w==',key_name='tempest-keypair-1522213741',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:36Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-dlsx8ygy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:35.000579 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "6514bca4-f763-4523-8c91-0dc665bac7eb", "address": "fa:16:3e:f7:9d:a2", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514bca4-f7", "ovs_interfaceid": "6514bca4-f763-4523-8c91-0dc665bac7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:35.001337 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:35.001598 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:35.005972 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.006300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6514bca4-f7, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:35.007611 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.008895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:35.010068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.011013 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.011013 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6773969c-24f2-48c3-8067-dc9351689a4f) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:35.011954 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.011954 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:35.012789 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:35.015477 np0000000741 nova-compute[97948]: INFO os_vif [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9d:a2,bridge_name='br-int',has_traffic_filtering=True,id=6514bca4-f763-4523-8c91-0dc665bac7eb,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514bca4-f7')
May 14 03:48:35.015594 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Deleting instance files /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6_del
May 14 03:48:35.019624 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Deletion of /opt/stack/data/nova/instances/8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6_del complete
May 14 03:48:35.213929 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:35.367117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found WWN 330000000adcff3bd for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:48:35.367684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:35.367860 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000adcff3bd', 'path': '/dev/dm-1', 'multipath_id': '330000000adcff3bd'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:35.368036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000adcff3bd', 'path': '/dev/dm-1', 'multipath_id': '330000000adcff3bd'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:48:35.371880 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:35.449898 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:35.452932 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.465668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:35.526517 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Took 1.44 seconds to destroy the instance on the hypervisor.
May 14 03:48:35.527306 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:35.527666 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:35.527792 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:35.528308 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:35.614790 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:35.722316 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.599s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:35.723560 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.965s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:35.797311 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:35.797592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:35.797997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:35.798107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:35.798256 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] No waiting events found dispatching network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:35.798374 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:35.798447 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:35.798652 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Acquiring lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:35.801833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:35.802125 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:35.802528 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] No waiting events found dispatching network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:35.803061 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fef18759-c0b5-452b-859e-ee17fe8e5556 req-9f3714bf-0df7-488b-a579-4bb63611aad3 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-unplugged-6514bca4-f763-4523-8c91-0dc665bac7eb for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:35.812947 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance 85c0d018-04a6-4eeb-94c7-73c7077c43f1
May 14 03:48:35.876419 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Attempting to attach volume 18079a50-eaee-43d2-99fc-10b86392ee1a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:48:35.877921 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:   <alias name="ua-18079a50-eaee-43d2-99fc-10b86392ee1a"/>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:   <serial>18079a50-eaee-43d2-99fc-10b86392ee1a</serial>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:35.877921 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:48:35.957045 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:48:35.957241 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730515.9570944, c91d7618-3b0d-4cdd-94b4-61424a502c3f => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:35.957340 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] VM Paused (Lifecycle Event)
May 14 03:48:35.969330 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Took 8.87 seconds to spawn the instance on the hypervisor.
May 14 03:48:35.969330 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:36.262543 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:36.262737 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:36.263251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:36.263740 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:36.264072 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] No waiting events found dispatching network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:36.264252 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-9c909b41-3464-4860-b66f-ef808b17000e req-1596a032-832e-429f-a333-f60378467f0d service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received unexpected event network-vif-plugged-92068630-02d8-4706-aaa7-f5109f99c04d for instance with vm_state active and task_state None.
May 14 03:48:36.462432 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:36.465191 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730516.464536, c91d7618-3b0d-4cdd-94b4-61424a502c3f => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:36.465191 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] VM Resumed (Lifecycle Event)
May 14 03:48:36.479246 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Took 16.44 seconds to build instance.
May 14 03:48:36.618046 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:36.805093 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance d65b01f4-8363-4e20-806e-71a97008228e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805093 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805093 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 39304f73-2e21-43f5-a634-2e1f42124be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805093 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805093 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c855e972-ae69-4b13-9b2f-6a588dbc3364 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805501 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.805761 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance c91d7618-3b0d-4cdd-94b4-61424a502c3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:48:36.806149 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:48:36.807088 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:48:34 up 40 min,  2 users,  load average: 5.43, 6.06, 4.84\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_67ffe6f2dced4996934bb21b97bd6dda': '2', 'io_workload': '1', 'num_proj_593121a21a7440a48c3f9ec54b7811bd': '2', 'num_task_deleting': '1', 'num_proj_43df7b9472f445dfbf816cb9b648332e': '1', 'num_proj_6af4cde5a4934c1e8d619ec5b8c8adc9': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:48:36.824934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-7118994a-7f10-4a3a-a675-e9b9e966d65c tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "85c0d018-04a6-4eeb-94c7-73c7077c43f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.453s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:36.967066 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:36.970457 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:36.982145 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.950s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:37.120676 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Took 1.59 seconds to deallocate network for instance.
May 14 03:48:37.233860 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:37.234019 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:37.548268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:37.548683 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:37.548683 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:37.548798 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] No VIF found with MAC fa:16:3e:8d:42:2e, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:37.555202 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:37.555412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:37.555604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:37.555789 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:37.555928 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:37.557995 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Terminating instance
May 14 03:48:37.625707 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:37.736496 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:37.873050 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b9a90b48-cb9b-4de5-afeb-1bec47d891f3 req-4b9f2136-6c9a-47e4-80ca-7c12ac5e03d5 service nova] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Received event network-vif-deleted-6514bca4-f763-4523-8c91-0dc665bac7eb {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:37.974869 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005028160003348603 future=<Future at 0x79d0906088c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:37.975210 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730502.9742684, a2050a6c-1c7b-4454-8a7e-14960f06b79b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:37.975328 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:37.975484 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] VM Stopped (Lifecycle Event)
May 14 03:48:37.977059 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.2056258980001076 future=<Future at 0x79d0b0217590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:37.977059 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=2.2055046649998076 future=<Future at 0x79d0b0217590 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:38.061441 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:38.089458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.091476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.120627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.228066 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.233467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.242313 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:48:38.242461 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.520s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:38.242760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.617s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:38.242971 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:38.362562 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.376715 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.393922 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999724621999576 future=<Future at 0x79d0b82b8830 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:38.396501 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Instance destroyed successfully.
May 14 03:48:38.397027 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:38.479712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: a2050a6c-1c7b-4454-8a7e-14960f06b79b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:38.510129 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:38.613893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:38.614281 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:38.890024 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.899079 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='multiattach-server-0',id=49,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2bjrS/7uPbwZn2IHbn6iIKrSjgqtnMKORbnJA5l9NWLpf65C2AmkM8Md4/sDfMP4+kldKf9PtQunK73BG9x7GHSTDLY2aQ+kKSL66BpdnwL5M+LPa9y79z+7tEDdpJA==',key_name='tempest-keypair-606803905',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:37Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-73qbfxbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c064a5847d91427796b822208d60fa59',uuid=179fc6e1-dfbb-4b6c-9dc7-9b1113470271,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:38.899312 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "address": "fa:16:3e:92:e4:d2", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e51b4dc-19", "ovs_interfaceid": "4e51b4dc-190b-42e0-95b5-f061b10f594f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:38.899770 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:38.899988 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:38.901749 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.901749 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e51b4dc-19, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:38.902130 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.903170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:38.904416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.904416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=856826c0-1531-410a-8599-9625c9eeb32e) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:38.905128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.905128 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:38.905694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:38.906888 np0000000741 nova-compute[97948]: INFO os_vif [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e4:d2,bridge_name='br-int',has_traffic_filtering=True,id=4e51b4dc-190b-42e0-95b5-f061b10f594f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e51b4dc-19')
May 14 03:48:38.907112 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Deleting instance files /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271_del
May 14 03:48:38.907845 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Deletion of /opt/stack/data/nova/instances/179fc6e1-dfbb-4b6c-9dc7-9b1113470271_del complete
May 14 03:48:39.114890 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-44ab4dc6-31c8-4dfb-af88-682682e08a96 tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.521s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:39.116481 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:39.236895 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:39.237119 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:39.237381 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:48:39.237646 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.55 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:48:39.418811 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:48:39.419437 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:39.419858 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:39.419929 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:39.420198 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:39.480282 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:39.625042 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.382s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:39.689982 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deleted allocations for instance 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6
May 14 03:48:39.766190 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1e6758ee-4879-4566-ab8d-1e433dd1500f req-b600db6d-7511-44cf-a2cc-a31cc3432562 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-deleted-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:39.766540 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-1e6758ee-4879-4566-ab8d-1e433dd1500f req-b600db6d-7511-44cf-a2cc-a31cc3432562 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Neutron deleted interface 4e51b4dc-190b-42e0-95b5-f061b10f594f; detaching it from the instance and deleting it from the info cache
May 14 03:48:39.766724 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-1e6758ee-4879-4566-ab8d-1e433dd1500f req-b600db6d-7511-44cf-a2cc-a31cc3432562 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:39.927489 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-changed-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:39.927631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Refreshing instance network info cache due to event network-changed-92068630-02d8-4706-aaa7-f5109f99c04d. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:39.927793 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Acquiring lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:39.927893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Acquired lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:39.928675 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Refreshing network info cache for port 92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:40.182513 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003525639999679697 future=<Future at 0x79d0b0217590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:40.182930 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730505.1819801, 203f4e13-7bd5-4060-92d1-37674b547f4a => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:40.183079 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:40.183266 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] VM Stopped (Lifecycle Event)
May 14 03:48:40.183786 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.03783105399998 future=<Future at 0x79d0b84e6300 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:40.185551 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.036056872000245 future=<Future at 0x79d0b84e6300 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:40.216253 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:40.270405 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1e6758ee-4879-4566-ab8d-1e433dd1500f req-b600db6d-7511-44cf-a2cc-a31cc3432562 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Detach interface failed, port_id=4e51b4dc-190b-42e0-95b5-f061b10f594f, reason: Instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:40.429593 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:40.688012 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-d34e3438-a6a1-4ebe-8be1-3a54d93c8dfa tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 203f4e13-7bd5-4060-92d1-37674b547f4a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:40.696388 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:40.717469 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Took 1.30 seconds to deallocate network for instance.
May 14 03:48:40.718256 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-514645e9-7782-4f2e-acfb-98b47751fefc tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.149s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:40.818916 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updated VIF entry in instance network info cache for port 92068630-02d8-4706-aaa7-f5109f99c04d. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:40.819138 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating instance_info_cache with network_info: [{"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:41.248677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:41.249961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Releasing lock "refresh_cache-c91d7618-3b0d-4cdd-94b4-61424a502c3f" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] No waiting events found dispatching network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:41.324722 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:41.324892 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:41.325030 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Acquiring lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:41.325159 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:41.325261 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:41.325321 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] No waiting events found dispatching network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:41.325426 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8989ae88-0939-48b3-b249-caab30027e1b req-b9245acc-738f-48a6-9a9e-d355e41ff0b3 service nova] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Received event network-vif-unplugged-4e51b4dc-190b-42e0-95b5-f061b10f594f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:41.622918 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:41.623177 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:41.859200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:41.859599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:42.126257 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:42.361261 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Detaching volume 18079a50-eaee-43d2-99fc-10b86392ee1a
May 14 03:48:42.398680 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Attempting to driver detach volume 18079a50-eaee-43d2-99fc-10b86392ee1a from mountpoint /dev/vdb
May 14 03:48:42.404307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found disk vdb by alias ua-18079a50-eaee-43d2-99fc-10b86392ee1a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:42.405370 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Found disk vdb by alias ua-18079a50-eaee-43d2-99fc-10b86392ee1a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:48:42.405478 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Attempting to detach device vdb from instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:48:42.405680 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <alias name="ua-18079a50-eaee-43d2-99fc-10b86392ee1a"/>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <serial>18079a50-eaee-43d2-99fc-10b86392ee1a</serial>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:42.405680 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:42.411167 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully detached device vdb from instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb from the persistent domain config.
May 14 03:48:42.411294 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] (1/8): Attempting to detach device vdb with device alias ua-18079a50-eaee-43d2-99fc-10b86392ee1a from instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:48:42.411486 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <alias name="ua-18079a50-eaee-43d2-99fc-10b86392ee1a"/>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <serial>18079a50-eaee-43d2-99fc-10b86392ee1a</serial>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]: </disk>
May 14 03:48:42.411486 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:48:42.635245 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.385s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:42.685934 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance 179fc6e1-dfbb-4b6c-9dc7-9b1113470271
May 14 03:48:42.936918 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730522.9365826, 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb => ua-18079a50-eaee-43d2-99fc-10b86392ee1a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:48:42.937415 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-18079a50-eaee-43d2-99fc-10b86392ee1a for instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:48:42.939413 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully detached device vdb from instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb from the live domain config.
May 14 03:48:42.940379 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:42.940671 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:42.940808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:42.941162 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:42.941449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18079a50-eaee-43d2-99fc-10b86392ee1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:42.941592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:42.967690 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:42.968021 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:42.968021 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', '173'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '176')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:42.968275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', '173')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:42.969156 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a', '174')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:42.970092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b045a520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:42.970241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Removing multipathed devices sdd, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:42.970466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Flush multipath device 330000000adcff3bd {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:43.000500 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:43.046258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:43.093025 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:43.093186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:43.094286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:43.106889 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:43.107047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:43.118756 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.156624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.40.100,3260]
May 14 03:48:43.156624 np0000000741 nova-compute[97948]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.40.100,3260] successful.
May 14 03:48:43.156624 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.177140 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.185946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.215862 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.50.100,3260]
May 14 03:48:43.215862 np0000000741 nova-compute[97948]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-18079a50-eaee-43d2-99fc-10b86392ee1a, portal: 192.168.50.100,3260] successful.
May 14 03:48:43.215862 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.233799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:43.233973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:43.234167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] <== disconnect_volume: return (293ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:43.234167 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:43.694707 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-52ebadb5-0c31-4e3d-bff4-95f1e16716ab tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "179fc6e1-dfbb-4b6c-9dc7-9b1113470271" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:43.776599 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'flavor' on Instance uuid 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:43.892194 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:43.904694 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:44.663678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:44.664010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:44.785923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ebeebeac-c844-400c-a059-d3fcb12f1b0e tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.926s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:44.865043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:44.865140 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing instance network info cache due to event network-changed-062e9b78-b3d4-4377-af3b-0c3446844a59. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:44.866062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] Acquiring lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:44.866599 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] Acquired lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:44.866916 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Refreshing network info cache for port 062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:45.145134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.145134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.145134 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.145304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.145304 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:45.148245 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Terminating instance
May 14 03:48:45.166100 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:48:45.369052 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:45.384416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.384416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.384416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.384416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.384416 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:45.386012 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Terminating instance
May 14 03:48:45.655093 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:45.656052 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:45.678840 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.681766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.700024 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.704318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.727525 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.740069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.740069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.744860 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:48:45.745281 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Claim successful on node np0000000741
May 14 03:48:45.839438 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updated VIF entry in instance network info cache for port 062e9b78-b3d4-4377-af3b-0c3446844a59. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:45.839957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [{"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:45.879871 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:45.879871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:45.879871 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:45.882600 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:45.883200 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] No waiting events found dispatching network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:45.883366 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-77dda535-af0c-4b9f-83ff-29ec0ecfd3f9 req-07c21a34-b620-4347-a685-0493af537b87 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:45.888545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:45.916674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.924033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:45.940317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.003004 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999752092000108 future=<Future at 0x79d0b8143650 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.011363 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Instance destroyed successfully.
May 14 03:48:46.013183 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lazy-loading 'resources' on Instance uuid d65b01f4-8363-4e20-806e-71a97008228e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:46.065871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.076005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.083045 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:46.083513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:46.083781 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:46.084379 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:46.084379 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] No waiting events found dispatching network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:46.084744 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8842ff26-ce0e-40ad-ba41-d8539acaade3 req-df47f6f2-b1a6-4b22-9579-a61ebce783b5 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:46.222884 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004318030000831641 future=<Future at 0x79d0b84e6300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.222884 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Emitting event <LifecycleEvent: 1778730511.2215528, 85c0d018-04a6-4eeb-94c7-73c7077c43f1 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:46.222884 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.223067 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] VM Stopped (Lifecycle Event)
May 14 03:48:46.223956 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.2314622169997165 future=<Future at 0x79d0b81a35f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.224192 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.2312341859997105 future=<Future at 0x79d0b81a35f0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.247294 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999726695999925 future=<Future at 0x79d090748920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:46.247939 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Instance destroyed successfully.
May 14 03:48:46.248315 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'resources' on Instance uuid 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:46.342505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cc74eb78-7fc1-4e9f-baeb-324d1a4d3bc7 req-f914549c-3a35-4f1e-bf84-1efe824fcec5 service nova] Releasing lock "refresh_cache-65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:46.518363 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1529622204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-attachvolumemultiattachtest-server-1529622204',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:43:17Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ffe6f2dced4996934bb21b97bd6dda',ramdisk_id='',reservation_id='r-2565mqvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-221885421',owner_user_name='tempest-AttachVolumeMultiAttachTest-221885421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:43:18Z,user_data=None,user_id='c064a5847d91427796b822208d60fa59',uuid=d65b01f4-8363-4e20-806e-71a97008228e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:46.518603 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converting VIF {"id": "6abf4349-a3fd-4067-924e-72e88666c56f", "address": "fa:16:3e:c1:d7:44", "network": {"id": "6cdc8e22-09a0-4fe9-b548-1babc9ce73b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-831390581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "67ffe6f2dced4996934bb21b97bd6dda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abf4349-a3", "ovs_interfaceid": "6abf4349-a3fd-4067-924e-72e88666c56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:46.519291 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:46.519588 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:46.520548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.520743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abf4349-a3, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:46.528702 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.530273 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:46.534325 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.535079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.535317 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=585c2e0c-db82-49f5-8ed3-849c1e14daba) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:46.535724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.536202 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:46.540508 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.542239 np0000000741 nova-compute[97948]: INFO os_vif [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d7:44,bridge_name='br-int',has_traffic_filtering=True,id=6abf4349-a3fd-4067-924e-72e88666c56f,network=Network(6cdc8e22-09a0-4fe9-b548-1babc9ce73b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abf4349-a3')
May 14 03:48:46.575219 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:48:46.575549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:46.575721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:46.576072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:46.576410 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77c23625-bf8d-422a-8094-368336e78435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:48:46.576566 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:46.602017 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsi session list stdout=tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435 (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:46.602430 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '176')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:48:46.602430 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '116')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:46.603278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435', '117')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:48:46.604087 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8175080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'): ({'sdi'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:48:46.604259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:48:46.604442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Flush multipath device 3300000006f3df236 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:48:46.651918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:46.693751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:48:46.725550 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5208921d-6ef5-4db3-868f-ab4592a1819a tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 85c0d018-04a6-4eeb-94c7-73c7077c43f1] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:46.733376 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:48:46.733514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:48:46.734433 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:48:46.746897 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:48:46.747117 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:48:46.753841 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1007201020',display_name='tempest-TestStampPattern-server-1007201020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1007201020',id=66,image_ref='e5ef9e9d-d918-444a-8a75-e38f3e997215',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:50Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-b63s9ou6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='39304f73-2e21-43f5-a634-2e1f42124be5',image_min_disk='1',image_min_ram='0',image_owner_id='593121a21a7440a48c3f9ec54b7811bd',image_owner_project_name='tempest-TestStampPattern-671027015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-671027015-project-member',image_user_id='8cd05bb8cd0642019599037e8f145541',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:51Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:46.756132 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "062e9b78-b3d4-4377-af3b-0c3446844a59", "address": "fa:16:3e:8d:42:2e", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap062e9b78-b3", "ovs_interfaceid": "062e9b78-b3d4-4377-af3b-0c3446844a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:46.756624 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:46.756848 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:46.757834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.758096 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap062e9b78-b3, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:46.762820 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.763155 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.764422 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:46.765159 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.765322 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18c77b68-593f-4555-bb6c-0889c3ba54d6) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:46.765972 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.766523 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:46.766718 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:46.768456 np0000000741 nova-compute[97948]: INFO os_vif [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:42:2e,bridge_name='br-int',has_traffic_filtering=True,id=062e9b78-b3d4-4377-af3b-0c3446844a59,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062e9b78-b3')
May 14 03:48:46.768765 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Deleting instance files /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb_del
May 14 03:48:46.769497 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Deletion of /opt/stack/data/nova/instances/65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb_del complete
May 14 03:48:46.796037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.40.100,3260]
May 14 03:48:46.796037 np0000000741 nova-compute[97948]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.40.100,3260] successful.
May 14 03:48:46.796037 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.814415 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.826550 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.863399 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.50.100,3260]
May 14 03:48:46.863399 np0000000741 nova-compute[97948]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-77c23625-bf8d-422a-8094-368336e78435, portal: 192.168.50.100,3260] successful.
May 14 03:48:46.863399 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.881564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:46.881787 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:46.881887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] <== disconnect_volume: return (306ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:46.882032 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:48:46.882224 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Deleting instance files /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e_del
May 14 03:48:46.882692 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Deletion of /opt/stack/data/nova/instances/d65b01f4-8363-4e20-806e-71a97008228e_del complete
May 14 03:48:47.066900 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:47.067170 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:47.278462 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 03:48:47.278892 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:47.279324 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:47.279428 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:47.279689 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:47.388170 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Took 1.73 seconds to destroy the instance on the hypervisor.
May 14 03:48:47.388726 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:47.389075 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:47.389200 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:47.389458 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:47.404323 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:47.461656 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:47.571682 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:47.967954 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:47.968434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] Acquiring lock "d65b01f4-8363-4e20-806e-71a97008228e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:47.968434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:47.968434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] Lock "d65b01f4-8363-4e20-806e-71a97008228e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:47.968434 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] No waiting events found dispatching network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:47.968660 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-unplugged-6abf4349-a3fd-4067-924e-72e88666c56f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:47.969206 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Received event network-vif-deleted-6abf4349-a3fd-4067-924e-72e88666c56f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:47.969362 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Neutron deleted interface 6abf4349-a3fd-4067-924e-72e88666c56f; detaching it from the instance and deleting it from the info cache
May 14 03:48:47.969471 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:48.084337 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:48.084772 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:48:48.158369 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:48.192885 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:48.193071 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] Acquiring lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:48.193212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:48.193317 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:48.193419 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] No waiting events found dispatching network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:48.193536 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-unplugged-062e9b78-b3d4-4377-af3b-0c3446844a59 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:48.193672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Received event network-vif-deleted-062e9b78-b3d4-4377-af3b-0c3446844a59 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:48.194327 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Neutron deleted interface 062e9b78-b3d4-4377-af3b-0c3446844a59; detaching it from the instance and deleting it from the info cache
May 14 03:48:48.194585 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:48.202760 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:48.474841 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12fbe716-47ac-40c4-a956-9d3670f69ea7 req-1dbe96ac-60e4-4cbd-850b-f8634347af85 service nova] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Detach interface failed, port_id=6abf4349-a3fd-4067-924e-72e88666c56f, reason: Instance d65b01f4-8363-4e20-806e-71a97008228e could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:48.592320 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:48:48.593237 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:48:48.593583 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:48.593867 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:48.659705 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Took 1.38 seconds to deallocate network for instance.
May 14 03:48:48.672725 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '547494feb9d9440690768b7350f15860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43df7b9472f445dfbf816cb9b648332e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:48:48.698614 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8edb07f9-1986-4e25-866a-3ef059cb1fd1 req-7daa9225-482d-4669-b164-0229a994f771 service nova] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Detach interface failed, port_id=062e9b78-b3d4-4377-af3b-0c3446844a59, reason: Instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:48.704318 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Took 1.32 seconds to deallocate network for instance.
May 14 03:48:48.895171 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:49.093682 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:48:49.159959 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Successfully created port: 4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:48:49.166424 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:49.166769 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:49.258969 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:48:49.455769 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003400600003260479 future=<Future at 0x79d0b81a35f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:49.457243 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730514.4553185, 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:49.457389 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:49.457514 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.936112146999676 future=<Future at 0x79d0b82b8830 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:49.457596 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=3.936026849999962 future=<Future at 0x79d0b82b8830 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:49.457596 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] VM Stopped (Lifecycle Event)
May 14 03:48:49.505678 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:49.506046 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:49.596825 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:48:49.709546 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Successfully updated port: 4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:48:49.756368 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-changed-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:49.756809 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Refreshing instance network info cache due to event network-changed-4d05466d-efb8-4044-b7cc-82e97dad0137. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:49.757130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] Acquiring lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:49.757273 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] Acquired lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:49.757541 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Refreshing network info cache for port 4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:49.775383 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:49.961603 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 8db3c9d5-aa7b-49f8-89ab-b8588cf1c5b6] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:50.008751 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:50.211631 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:50.259843 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:50.324908 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:48:50.451557 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:50.517035 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.350s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:50.519883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.745s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:50.589380 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Deleted allocations for instance 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb
May 14 03:48:50.604650 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:48:50.605451 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:48:50.605993 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Creating image(s)
May 14 03:48:50.606400 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:50.606557 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:50.607018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:50.607576 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:48:50.610124 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:48:50.611164 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:50.710422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:50.710868 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:50.711424 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:50.713779 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:48:50.716691 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:48:50.721073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:50.810968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:50.811307 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:50.867116 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk 1073741824" returned: 0 in 0.055s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:50.867535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:50.867927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:50.943300 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:50.943300 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:50.954537 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-237b2187-bbb3-4397-8d1f-d614ed81de9e req-35db9606-73c3-4360-b9fa-3ffc03914f32 service nova] Releasing lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:50.957160 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:50.957570 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:48:50.957858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:50.958742 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquired lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:50.958794 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:48:51.052836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:51.053279 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Cannot resize image /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:48:51.053862 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:48:51.054018 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Ensure instance console log exists: /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:48:51.054376 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:51.054683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:51.054888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:51.173107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:51.173362 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:51.446973 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:51.546541 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:48:51.602518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0bb30fbc-d717-41c3-8cb1-a3fbcfee38bf tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.219s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:51.676363 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:48:51.687026 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:51.766755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:51.813028 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating instance_info_cache with network_info: [{"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:51.953104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.433s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:52.010103 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Deleted allocations for instance d65b01f4-8363-4e20-806e-71a97008228e
May 14 03:48:52.226058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:52.226182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:52.230456 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:48:52.230562 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Claim successful on node np0000000741
May 14 03:48:52.314929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Releasing lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:52.315181 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance network_info: |[{"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:48:52.316934 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Start _get_guest_xml network_info=[{"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:48:52.319294 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:48:52.320397 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-374823671', uuid='1c4c59c3-660c-4f36-b589-af95eb8924f5'), owner=OwnerMeta(userid='547494feb9d9440690768b7350f15860', username='tempest-TestEncryptedCinderVolumes-402629128-project-member', projectid='43df7b9472f445dfbf816cb9b648332e', projectname='tempest-TestEncryptedCinderVolumes-402629128'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730532.3200567) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:48:52.321497 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:48:52.321811 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:48:52.323122 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:48:52.323307 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:48:52.324107 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:48:52.324455 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:48:52.324584 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:48:52.324688 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:48:52.324803 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:48:52.324882 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:48:52.324986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:48:52.325137 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:48:52.325236 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:48:52.325341 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:48:52.325435 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:48:52.325545 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:48:52.335722 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-374823671',display_name='tempest-TestEncryptedCinderVolumes-server-374823671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-374823671',id=69,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKGIyOazPk+4IZsYmr0DF6GmnMDqlwZ3T7X66iy07q/iKoYq5FGOoyg6VaFswj4VfWzmY2CGql2KA1oKLe4StnJXlHiarqNx05RgzZ5AJdJeUNHMkzSMTdlB0+g48hDYQ==',key_name='tempest-keypair-1901818413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-3c8mh1jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=1c4c59c3-660c-4f36-b589-af95eb8924f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:48:52.335926 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:52.336385 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:52.336885 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:52.839896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] End _get_guest_xml xml=<domain type="qemu">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <uuid>1c4c59c3-660c-4f36-b589-af95eb8924f5</uuid>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <name>instance-00000045</name>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-374823671</nova:name>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:48:52</nova:creationTime>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:user uuid="547494feb9d9440690768b7350f15860">tempest-TestEncryptedCinderVolumes-402629128-project-member</nova:user>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:project uuid="43df7b9472f445dfbf816cb9b648332e">tempest-TestEncryptedCinderVolumes-402629128</nova:project>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         <nova:port uuid="4d05466d-efb8-4044-b7cc-82e97dad0137">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <system>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="serial">1c4c59c3-660c-4f36-b589-af95eb8924f5</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="uuid">1c4c59c3-660c-4f36-b589-af95eb8924f5</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </system>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <os>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </os>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <features>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </features>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   <devices>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </disk>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.config"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </disk>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:a7:37:cc"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <target dev="tap4d05466d-ef"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </interface>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/console.log" append="off"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </serial>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <video>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </video>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </rng>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:   </devices>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]: </domain>
May 14 03:48:52.839896 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Preparing to wait for external event network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-374823671',display_name='tempest-TestEncryptedCinderVolumes-server-374823671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-374823671',id=69,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKGIyOazPk+4IZsYmr0DF6GmnMDqlwZ3T7X66iy07q/iKoYq5FGOoyg6VaFswj4VfWzmY2CGql2KA1oKLe4StnJXlHiarqNx05RgzZ5AJdJeUNHMkzSMTdlB0+g48hDYQ==',key_name='tempest-keypair-1901818413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-3c8mh1jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=1c4c59c3-660c-4f36-b589-af95eb8924f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.843410 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:52.844023 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:48:52.844536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.844728 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb6569ae-58f2-5566-a423-7584a917e9e5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:52.845479 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.846466 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:52.848124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.848260 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d05466d-ef, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:52.848616 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d05466d-ef, col_values=(('qos', UUID('f89316fc-8f10-41d2-8b60-e06ddc888ae8')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:52.848792 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d05466d-ef, col_values=(('external_ids', {'iface-id': '4d05466d-efb8-4044-b7cc-82e97dad0137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:37:cc', 'vm-uuid': '1c4c59c3-660c-4f36-b589-af95eb8924f5'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:52.849472 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.850556 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:52.855677 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:52.856537 np0000000741 nova-compute[97948]: INFO os_vif [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef')
May 14 03:48:53.018593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ddd75db-999f-406c-9c37-1db3e5632763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Lock "d65b01f4-8363-4e20-806e-71a97008228e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.874s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:53.395984 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0023041420004119573 future=<Future at 0x79d0b82b8830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:53.396240 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:53.396699 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] Emitting event <LifecycleEvent: 1778730518.3935654, 179fc6e1-dfbb-4b6c-9dc7-9b1113470271 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:53.396896 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.6050895540001875 future=<Future at 0x79d0b8143650 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:53.397089 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] VM Stopped (Lifecycle Event)
May 14 03:48:53.398220 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=7.6037517959998695 future=<Future at 0x79d0b8143650 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:53.518244 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:53.518437 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:53.895437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:53.899625 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-e152e5ea-9fa5-448c-a007-b266ea702763 tempest-AttachVolumeMultiAttachTest-221885421 tempest-AttachVolumeMultiAttachTest-221885421-project-member] [instance: 179fc6e1-dfbb-4b6c-9dc7-9b1113470271] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:54.020943 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:54.373462 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:54.373627 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:48:54.373718 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:a7:37:cc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:48:54.374141 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Using config drive
May 14 03:48:54.528845 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.302s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:54.530672 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:48:54.668470 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:54.669044 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing instance network info cache due to event network-changed-d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:54.669381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] Acquiring lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:54.669381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] Acquired lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:54.669381 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Refreshing network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:54.879190 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:55.004502 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Creating config drive at /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.config
May 14 03:48:55.010023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6trmip19 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:55.042169 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:48:55.042459 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:48:55.043285 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:55.043791 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:55.072070 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6trmip19" returned: 0 in 0.062s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:48:55.124409 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ce7f78f81b4fe780ebc7a1d615a0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb53bd4f2841db99df994d7e6c2a72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:48:55.172838 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:55.193107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:55.193971 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:55.196224 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:55.196997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:55.197184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:55.202447 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Terminating instance
May 14 03:48:55.392522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.456855 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:55.524886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.549916 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:48:55.553437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.638666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.676429 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Successfully created port: 8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:48:55.696681 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updated VIF entry in instance network info cache for port d0b4176c-966a-40f9-bb20-18922b0ebe3c. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:55.696823 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [{"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:55.704794 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:48:55.725018 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.736657 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.760282 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.849960 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.857670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.861733 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.886754 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.892837 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:55.909176 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:55.909305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:55.909482 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:55.910066 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:55.910300 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] No waiting events found dispatching network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:55.910450 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d954a08-29fa-4fb7-9f8d-b6ae088d79ff req-43f111d8-e867-4901-9333-49bf36f3723a service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:55.914289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d97782a-83ec-4006-9c08-86b2d0c75930 req-12a72c0c-29d6-4130-bcc6-2e1e0b0ebc8c service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:55.914470 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d97782a-83ec-4006-9c08-86b2d0c75930 req-12a72c0c-29d6-4130-bcc6-2e1e0b0ebc8c service nova] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:55.914609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d97782a-83ec-4006-9c08-86b2d0c75930 req-12a72c0c-29d6-4130-bcc6-2e1e0b0ebc8c service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:55.914772 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3d97782a-83ec-4006-9c08-86b2d0c75930 req-12a72c0c-29d6-4130-bcc6-2e1e0b0ebc8c service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:55.914904 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3d97782a-83ec-4006-9c08-86b2d0c75930 req-12a72c0c-29d6-4130-bcc6-2e1e0b0ebc8c service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Processing event network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:48:55.998547 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.024727 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.029779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.031312 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999648772 future=<Future at 0x79d0b01b2810 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:48:56.034024 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Instance destroyed successfully.
May 14 03:48:56.034398 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lazy-loading 'resources' on Instance uuid 39304f73-2e21-43f5-a634-2e1f42124be5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:48:56.057403 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:48:56.198616 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9a4030cc-5c2a-4bd5-9725-ba4482201eaa req-8eb41535-8a79-4892-9d0f-9c2247ea22d7 service nova] Releasing lock "refresh_cache-39304f73-2e21-43f5-a634-2e1f42124be5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:56.379517 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730536.3790581, 1c4c59c3-660c-4f36-b589-af95eb8924f5 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:56.380043 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:48:56.380180 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] VM Started (Lifecycle Event)
May 14 03:48:56.382164 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:48:56.384710 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance spawned successfully.
May 14 03:48:56.385248 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:48:56.438695 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Successfully updated port: 8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:48:56.537148 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1466566586',display_name='tempest-TestStampPattern-server-1466566586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-teststamppattern-server-1466566586',id=61,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Mr9yRmUHMgLkjzseSHp3VmLwFJ0Kp+bUNc5nHwocv+KEFWWl6ph+OPj3CP87gTAE4IlolsUh5g3h1oR1uwLheMqFAk7Uq4fxSl9zSpNMqvNFS5N7beUY6ALUBhOQgBA==',key_name='tempest-TestStampPattern-176170791',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:46:24Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='593121a21a7440a48c3f9ec54b7811bd',ramdisk_id='',reservation_id='r-7d1iiqsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-671027015',owner_user_name='tempest-TestStampPattern-671027015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:47:32Z,user_data=None,user_id='8cd05bb8cd0642019599037e8f145541',uuid=39304f73-2e21-43f5-a634-2e1f42124be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:48:56.537362 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converting VIF {"id": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "address": "fa:16:3e:5d:fa:18", "network": {"id": "4c38d08b-8057-48df-a0da-4f4a769b9d00", "bridge": "br-int", "label": "tempest-TestStampPattern-913925567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593121a21a7440a48c3f9ec54b7811bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b4176c-96", "ovs_interfaceid": "d0b4176c-966a-40f9-bb20-18922b0ebe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:48:56.538002 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:48:56.538250 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:48:56.539717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.540010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b4176c-96, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:56.541518 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.543163 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:56.543831 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:56.544076 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eaa94c66-a14d-487a-af1b-3f02cbfe0d0c) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:48:56.545990 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:48:56.547879 np0000000741 nova-compute[97948]: INFO os_vif [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:fa:18,bridge_name='br-int',has_traffic_filtering=True,id=d0b4176c-966a-40f9-bb20-18922b0ebe3c,network=Network(4c38d08b-8057-48df-a0da-4f4a769b9d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b4176c-96')
May 14 03:48:56.548204 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Deleting instance files /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5_del
May 14 03:48:56.549439 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Deletion of /opt/stack/data/nova/instances/39304f73-2e21-43f5-a634-2e1f42124be5_del complete
May 14 03:48:56.560239 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Booting with volume c63867b8-f5cb-455a-9f57-59a0149d4586 at /dev/vda
May 14 03:48:56.601307 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:56.612164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:48:56.631413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:48:56.677730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:48:56.678028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:48:56.686292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:48:56.687361 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fefe:d587', 'fe80::b833:a7ff:fe2f:cbac', 'fe80::fc16:3eff:fe79:1d6e', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fea7:37cc', 'fe80::301d:fdff:fe12:5c43'] 
May 14 03:48:56.687474 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:48:56.687632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:48:56.688084 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:48:56.688339 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating existing volume attachment record: ddbac87a-a0d7-4f1a-aaeb-1f77089ddb2a {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:48:56.883819 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:56.889416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:56.892551 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.892730 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.893094 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.893352 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.893689 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.893992 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:48:56.941287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:56.941479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquired lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:56.941572 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:48:57.056154 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 03:48:57.056955 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:48:57.057258 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:48:57.057348 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:48:57.057626 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:57.162559 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:57.393072 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:48:57.393072 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730537.3922102, 1c4c59c3-660c-4f36-b589-af95eb8924f5 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:57.393072 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] VM Paused (Lifecycle Event)
May 14 03:48:57.398699 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Took 6.79 seconds to spawn the instance on the hypervisor.
May 14 03:48:57.398949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:57.461018 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-30462a01-5d93-4e99-a7f5-5e6a2e413035 req-8a1b0c65-6005-47c3-9361-f88f7f1f4e8b service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-deleted-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:57.464426 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-30462a01-5d93-4e99-a7f5-5e6a2e413035 req-8a1b0c65-6005-47c3-9361-f88f7f1f4e8b service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Neutron deleted interface d0b4176c-966a-40f9-bb20-18922b0ebe3c; detaching it from the instance and deleting it from the info cache
May 14 03:48:57.464426 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-30462a01-5d93-4e99-a7f5-5e6a2e413035 req-8a1b0c65-6005-47c3-9361-f88f7f1f4e8b service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:57.502009 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:48:57.633662 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:57.749086 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating instance_info_cache with network_info: [{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:57.900416 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:57.902441 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730537.9022512, 1c4c59c3-660c-4f36-b589-af95eb8924f5 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:48:57.902548 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] VM Resumed (Lifecycle Event)
May 14 03:48:57.909078 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Took 12.24 seconds to build instance.
May 14 03:48:57.915822 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:57.963673 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:57.963673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] Acquiring lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:57.963673 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:57.966827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] Lock "39304f73-2e21-43f5-a634-2e1f42124be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:57.966827 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] No waiting events found dispatching network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:57.966827 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-da4ce9a6-cba6-4192-906f-8de7a033610b req-f29d09e7-427d-4323-848d-14efb3af21dc service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Received event network-vif-unplugged-d0b4176c-966a-40f9-bb20-18922b0ebe3c for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:48:57.966827 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-30462a01-5d93-4e99-a7f5-5e6a2e413035 req-8a1b0c65-6005-47c3-9361-f88f7f1f4e8b service nova] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Detach interface failed, port_id=d0b4176c-966a-40f9-bb20-18922b0ebe3c, reason: Instance 39304f73-2e21-43f5-a634-2e1f42124be5 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:48:57.990660 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:57.991710 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:57.992079 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:57.992241 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:57.992414 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] No waiting events found dispatching network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:48:57.992583 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received unexpected event network-vif-plugged-4d05466d-efb8-4044-b7cc-82e97dad0137 for instance with vm_state active and task_state None.
May 14 03:48:57.992751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-changed-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:57.993036 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Refreshing instance network info cache due to event network-changed-8fbaa006-9713-415d-ad49-5c00dcac3f8a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:57.993198 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Acquiring lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:58.251422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Releasing lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:58.251781 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Instance network_info: |[{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:48:58.251948 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Acquired lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:58.252074 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Refreshing network info cache for port 8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:58.404709 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:48:58.407262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:48:58.410779 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe0-0cc8-422f-8c9c-332eddc26c81 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.747s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:58.417556 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Took 1.36 seconds to deallocate network for instance.
May 14 03:48:58.753926 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:58.786698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:48:58.787865 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:48:58.788158 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Creating image(s)
May 14 03:48:58.788455 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:48:58.788600 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Ensure instance console log exists: /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:48:58.788880 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:58.789063 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:58.789210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:48:58.789763 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Start _get_guest_xml network_info=[{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '52a6c262-080c-4a62-a33f-672d7dc93631', 'attached_at': '', 'detached_at': '', 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'serial': 'c63867b8-f5cb-455a-9f57-59a0149d4586'}, 'boot_index': 0, 'attachment_id': 'ddbac87a-a0d7-4f1a-aaeb-1f77089ddb2a', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:48:58.791999 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:48:58.793223 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-522319185', uuid='52a6c262-080c-4a62-a33f-672d7dc93631'), owner=OwnerMeta(userid='05ce7f78f81b4fe780ebc7a1d615a0ec', username='tempest-TestEncryptedCinderVolumes-2068807358-project-member', projectid='71fb53bd4f2841db99df994d7e6c2a72', projectname='tempest-TestEncryptedCinderVolumes-2068807358'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730538.7928975) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:48:58.794720 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:48:58.795119 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:48:58.796081 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:48:58.796268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:48:58.797522 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:48:58.797902 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:48:58.798083 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:48:58.798303 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:48:58.798447 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:48:58.798557 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:48:58.798708 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:48:58.798902 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:48:58.799031 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:48:58.799319 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:48:58.799516 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:48:58.799699 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:48:58.817410 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:48:58.817799 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:48:58.817960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:58.818349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:58.818579 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:48:58.831000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:58.831698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:48:58.832154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:58.832351 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:58.832746 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:48:58.832971 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:58.846747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:58.846747 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:58.849703 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:48:58.849703 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:58.857867 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586] added
May 14 03:48:58.857867 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:58.857867 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:58.857867 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:58.857867 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:58.857867 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:58.857867 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:58.858357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:58.858357 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:58.858357 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:58.860560 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586] added
May 14 03:48:58.860560 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:48:58.860560 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:58.860560 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:58.860560 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:48:58.860560 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:48:58.860560 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:58.860847 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:48:58.860847 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:48:58.860962 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:48:58.897189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:48:58.924190 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:48:58.924399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:48:59.057223 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:48:59.205411 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updated VIF entry in instance network info cache for port 8fbaa006-9713-415d-ad49-5c00dcac3f8a. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:48:59.205646 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating instance_info_cache with network_info: [{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:48:59.238735 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:48:59.238939 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:48:59.518552 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-changed-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:48:59.519061 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Refreshing instance network info cache due to event network-changed-4d05466d-efb8-4044-b7cc-82e97dad0137. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:48:59.519326 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] Acquiring lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:48:59.519622 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] Acquired lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:48:59.519622 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Refreshing network info cache for port 4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:48:59.707714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-280dda98-04ef-4cb3-b62e-62113eaa3ae7 req-9cf81c70-b0a6-4e1b-ac82-ea1d75d51bc3 service nova] Releasing lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:48:59.741362 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:48:59.858739 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:48:59.861264 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:59.871946 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:59.871946 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:48:59.877521 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:48:59.877521 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.885141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.893091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.902289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.902289 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.902289 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.902289 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.902289 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:59.902604 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.902604 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.902604 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.902604 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.902604 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:59.909707 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.909707 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.909707 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.909707 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.909707 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:59.909931 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.909931 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.909931 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.909931 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.909931 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:59.943015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.40.100,3260]
May 14 03:48:59.943015 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.40.100,3260] successful.
May 14 03:48:59.943015 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.951120 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.50.100,3260]
May 14 03:48:59.951120 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.50.100,3260] successful.
May 14 03:48:59.951120 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.955955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.962930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.971651 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.971904 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:59.972139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:59.972273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:59.973303 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('9', '-', '-', 0) found on session 177 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:59.973453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.982292 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:48:59.982668 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:48:59.982798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:48:59.982887 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:48:59.983615 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('12', '-', '-', 0) found on session 178 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:48:59.983751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:48:59.990224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 177 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:48:59.990413 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:48:59.999166 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 178 and hctl ['12', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:00.022717 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:00.248130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.324s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:00.303985 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Deleted allocations for instance 39304f73-2e21-43f5-a634-2e1f42124be5
May 14 03:49:00.325772 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:00.453374 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updated VIF entry in instance network info cache for port 4d05466d-efb8-4044-b7cc-82e97dad0137. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:00.453374 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating instance_info_cache with network_info: [{"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:00.955107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-254adda6-19c8-4361-a0c8-7d7bb34e0903 req-d86bce53-2ca9-4231-89e9-09b6d58b3cc4 service nova] Releasing lock "refresh_cache-1c4c59c3-660c-4f36-b589-af95eb8924f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:00.999529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 178 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:00.999682 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:49:01.002746 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004174159998910909 future=<Future at 0x79d0b8143650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.004398 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730526.0012765, d65b01f4-8363-4e20-806e-71a97008228e => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:01.004398 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.004398 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] VM Stopped (Lifecycle Event)
May 14 03:49:01.005907 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.24111314899982972 future=<Future at 0x79d090748920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.006035 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=0.24094632099968294 future=<Future at 0x79d090748920 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.247393 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003619640001488733 future=<Future at 0x79d090748920 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.247766 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.248079 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730526.2469332, 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:01.248289 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.782640465999975 future=<Future at 0x79d0b01b2810 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.248437 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.782480281000062 future=<Future at 0x79d0b01b2810 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:01.248956 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] VM Stopped (Lifecycle Event)
May 14 03:49:01.313561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5db475ac-2580-4e04-b87f-04ec77115f7c tempest-TestStampPattern-671027015 tempest-TestStampPattern-671027015-project-member] Lock "39304f73-2e21-43f5-a634-2e1f42124be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.120s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:01.506127 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: d65b01f4-8363-4e20-806e-71a97008228e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:01.545243 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:01.707815 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:01.708745 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing instance network info cache due to event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:01.708745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:01.708745 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:01.708745 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:01.751434 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 65ec337b-fa56-4e6d-b7f8-dd26bd01e4eb] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:01.849279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Found WWN 3300000006b217f3e for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:49:01.849515 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:01.850336 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000006b217f3e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006b217f3e'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:01.850477 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b217f3e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006b217f3e'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:49:01.881246 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '52a6c262-080c-4a62-a33f-672d7dc93631', 'attached_at': '', 'detached_at': '', 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'serial': 'c63867b8-f5cb-455a-9f57-59a0149d4586'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:49:01.881776 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:49:01.881990 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:01.882140 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:01.896232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:49:01.896232 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:49:01.896232 np0000000741 nova-compute[97948]:     <volume>c63867b8-f5cb-455a-9f57-59a0149d4586</volume>
May 14 03:49:01.896232 np0000000741 nova-compute[97948]:   </usage>
May 14 03:49:01.896232 np0000000741 nova-compute[97948]: </secret>
May 14 03:49:01.896232 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:49:02.021940 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.189800 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:02.189800 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing instance network info cache due to event network-changed-a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:02.189800 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] Acquiring lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:02.212139 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:02.403425 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-522319185',display_name='tempest-TestEncryptedCinderVolumes-server-522319185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-522319185',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-lljpclpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:56Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=52a6c262-080c-4a62-a33f-672d7dc93631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:49:02.403595 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:02.404256 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:02.405162 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'pci_devices' on Instance uuid 52a6c262-080c-4a62-a33f-672d7dc93631 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:02.548072 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:02.670318 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updated VIF entry in instance network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:02.670879 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:02.749496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:02.749683 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:02.907978 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] End _get_guest_xml xml=<domain type="qemu">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <uuid>52a6c262-080c-4a62-a33f-672d7dc93631</uuid>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <name>instance-00000046</name>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-522319185</nova:name>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:48:58</nova:creationTime>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:user uuid="05ce7f78f81b4fe780ebc7a1d615a0ec">tempest-TestEncryptedCinderVolumes-2068807358-project-member</nova:user>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:project uuid="71fb53bd4f2841db99df994d7e6c2a72">tempest-TestEncryptedCinderVolumes-2068807358</nova:project>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <nova:port uuid="8fbaa006-9713-415d-ad49-5c00dcac3f8a">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <system>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="serial">52a6c262-080c-4a62-a33f-672d7dc93631</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="uuid">52a6c262-080c-4a62-a33f-672d7dc93631</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </system>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <os>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </os>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <features>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </features>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   <devices>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/disk.config"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <alias name="ua-c63867b8-f5cb-455a-9f57-59a0149d4586"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <serial>c63867b8-f5cb-455a-9f57-59a0149d4586</serial>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <encryption format="luks">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:         <secret type="passphrase" uuid="d05d9066-2fe4-4307-8e2f-3c81857d57ef"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       </encryption>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:6d:72:85"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <target dev="tap8fbaa006-97"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </interface>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/console.log" append="off"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </serial>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <video>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </video>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </rng>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:   </devices>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]: </domain>
May 14 03:49:02.907978 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:49:02.909886 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Preparing to wait for external event network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:49:02.909886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:02.910231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:02.910419 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:02.911213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-522319185',display_name='tempest-TestEncryptedCinderVolumes-server-522319185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-522319185',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-lljpclpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:48:56Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=52a6c262-080c-4a62-a33f-672d7dc93631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:49:02.911520 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:02.912076 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:02.912424 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:49:02.913058 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.913339 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:02.913559 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:49:02.914304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.914467 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f133090-9e00-5a62-8d1e-ee9cca2d52fa', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:02.915911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.916518 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:02.921333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.921519 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbaa006-97, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:02.921914 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fbaa006-97, col_values=(('qos', UUID('6b54d447-ad61-497a-a2f4-f8c8e75ca1ad')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:02.922080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fbaa006-97, col_values=(('external_ids', {'iface-id': '8fbaa006-9713-415d-ad49-5c00dcac3f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:72:85', 'vm-uuid': '52a6c262-080c-4a62-a33f-672d7dc93631'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:02.925968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:02.928536 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:02.929687 np0000000741 nova-compute[97948]: INFO os_vif [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97')
May 14 03:49:03.172750 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a440174d-9ca2-452a-9e9a-848c7306fd41 req-2ca30103-f8e9-4da4-90b1-6c2dee3d9aba service nova] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:03.174803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] Acquired lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:03.174803 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Refreshing network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:03.251776 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Detaching volume e0105d07-8117-4b31-a348-332a3d89e05f
May 14 03:49:03.296310 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Attempting to driver detach volume e0105d07-8117-4b31-a348-332a3d89e05f from mountpoint /dev/vdb
May 14 03:49:03.306228 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found disk vdb by alias ua-e0105d07-8117-4b31-a348-332a3d89e05f {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:49:03.309243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Found disk vdb by alias ua-e0105d07-8117-4b31-a348-332a3d89e05f {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:49:03.309351 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Attempting to detach device vdb from instance c855e972-ae69-4b13-9b2f-6a588dbc3364 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:49:03.311017 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <alias name="ua-e0105d07-8117-4b31-a348-332a3d89e05f"/>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-10"/>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <serial>e0105d07-8117-4b31-a348-332a3d89e05f</serial>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]: </disk>
May 14 03:49:03.311017 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:49:03.326734 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully detached device vdb from instance c855e972-ae69-4b13-9b2f-6a588dbc3364 from the persistent domain config.
May 14 03:49:03.327090 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] (1/8): Attempting to detach device vdb with device alias ua-e0105d07-8117-4b31-a348-332a3d89e05f from instance c855e972-ae69-4b13-9b2f-6a588dbc3364 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:49:03.327335 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <alias name="ua-e0105d07-8117-4b31-a348-332a3d89e05f"/>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-10"/>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <serial>e0105d07-8117-4b31-a348-332a3d89e05f</serial>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]: </disk>
May 14 03:49:03.327335 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:49:03.677835 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:03.901820 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:03.911011 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730543.9106286, c855e972-ae69-4b13-9b2f-6a588dbc3364 => ua-e0105d07-8117-4b31-a348-332a3d89e05f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:49:03.914164 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e0105d07-8117-4b31-a348-332a3d89e05f for instance c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:49:03.919713 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully detached device vdb from instance c855e972-ae69-4b13-9b2f-6a588dbc3364 from the live domain config.
May 14 03:49:03.922085 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:49:03.922651 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:03.924057 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:03.924436 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:03.924721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0105d07-8117-4b31-a348-332a3d89e05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:49:03.924888 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:03.953358 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:03.953603 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:03.953803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '178')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:49:03.953868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '165')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:03.957689 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f', '166')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:03.958709 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c6840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'): ({'sdf'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:49:03.958947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Removing multipathed devices sdf, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:49:03.959136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Flush multipath device 33000000014fb94cf {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:49:03.994295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:04.045629 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:04.047592 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:04.103304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:49:04.103618 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:49:04.104358 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:49:04.115457 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:49:04.115668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:49:04.128463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.167157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.40.100,3260]
May 14 03:49:04.167157 np0000000741 nova-compute[97948]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.40.100,3260] successful.
May 14 03:49:04.167157 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.185746 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.189064 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updated VIF entry in instance network info cache for port a05fffde-eb69-4f28-8b37-639c483601f3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:04.189272 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [{"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:04.197603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.230278 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.50.100,3260]
May 14 03:49:04.230278 np0000000741 nova-compute[97948]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e0105d07-8117-4b31-a348-332a3d89e05f, portal: 192.168.50.100,3260] successful.
May 14 03:49:04.230278 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.244658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:04.244851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:04.244962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] <== disconnect_volume: return (322ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:04.245089 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:49:04.449668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:04.449885 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:04.450070 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No VIF found with MAC fa:16:3e:6d:72:85, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:49:04.450681 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Using config drive
May 14 03:49:04.455689 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:04.691078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-b2447a27-7552-434a-af10-a6be7cc4cb78 req-e025f8f5-1086-49ef-83ba-c87a24bc8f5d service nova] Releasing lock "refresh_cache-c855e972-ae69-4b13-9b2f-6a588dbc3364" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:04.811544 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'flavor' on Instance uuid c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:04.956226 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:05.083977 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Creating config drive at /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/disk.config
May 14 03:49:05.087349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp623rlysv {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:05.146377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp623rlysv" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:05.658297 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:05.682391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:05.799357 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:05.825791 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-89a1f381-23f0-49da-8fd1-118fc08e7dff tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.076s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:05.901048 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-da767e15-c511-4a64-8e53-82096dce07b3 req-1e95c521-27a0-41d1-bc23-b0e87ea9fe11 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:05.901228 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da767e15-c511-4a64-8e53-82096dce07b3 req-1e95c521-27a0-41d1-bc23-b0e87ea9fe11 service nova] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:05.902498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da767e15-c511-4a64-8e53-82096dce07b3 req-1e95c521-27a0-41d1-bc23-b0e87ea9fe11 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:05.902498 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-da767e15-c511-4a64-8e53-82096dce07b3 req-1e95c521-27a0-41d1-bc23-b0e87ea9fe11 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:05.902498 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-da767e15-c511-4a64-8e53-82096dce07b3 req-1e95c521-27a0-41d1-bc23-b0e87ea9fe11 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Processing event network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:49:06.030107 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:06.032545 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:06.036701 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:06.055903 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:06.550756 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.226351 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:07.226803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:07.226803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:07.226803 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:07.226909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:07.232021 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Terminating instance
May 14 03:49:07.461304 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:49:07.462312 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730547.4619374, 52a6c262-080c-4a62-a33f-672d7dc93631 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:07.462630 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] VM Started (Lifecycle Event)
May 14 03:49:07.464287 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:49:07.468144 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Instance spawned successfully.
May 14 03:49:07.468522 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:49:07.739049 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:49:07.762366 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.769070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.787138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.795667 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.834221 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.924798 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:07.968296 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:07.970338 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:07.975700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:07.975933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:07.976502 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:07.976567 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] No waiting events found dispatching network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:07.976737 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-f2e6fb64-2ffb-4e86-afca-2892cbe67d6d req-11a57b87-2fa9-4265-b77f-313698360bd1 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received unexpected event network-vif-plugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a for instance with vm_state building and task_state spawning.
May 14 03:49:07.977592 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:07.993423 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:07.993585 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:07.993916 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:07.994162 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:07.994427 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:07.994684 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:08.013097 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:08.013558 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:08.013715 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:08.013853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:08.014421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:08.015144 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-7d7b9e87-4de7-462e-a74c-3549c3d93e00 req-efc25b6f-5d55-4d1c-b8aa-0a9489e306b4 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:08.060437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.069978 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.092192 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Instance destroyed successfully.
May 14 03:49:08.092660 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lazy-loading 'resources' on Instance uuid c855e972-ae69-4b13-9b2f-6a588dbc3364 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:08.484804 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:49:08.485319 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730548.484929, 52a6c262-080c-4a62-a33f-672d7dc93631 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:08.485319 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] VM Paused (Lifecycle Event)
May 14 03:49:08.500840 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Took 9.71 seconds to spawn the instance on the hypervisor.
May 14 03:49:08.501407 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:08.595377 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1955071959',display_name='tempest-TestMinimumBasicScenario-server-1955071959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testminimumbasicscenario-server-1955071959',id=65,image_ref='2e50787c-049a-4929-814c-528901e4872d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlb4p5DOKf7B8WGaE4FF4FxVG4Rr1dpW63ZklDT+NcxE0f3vzpVR//WojgVbp1VqVQnVCjQ8Bu1QUA4Gihf/SvRIROiEHFfo6JnVWP1KLjBFxrRPiCvWK5VA4VEdDh1w==',key_name='tempest-TestMinimumBasicScenario-1434517968',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:47:47Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af4cde5a4934c1e8d619ec5b8c8adc9',ramdisk_id='',reservation_id='r-6p0fcc08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2e50787c-049a-4929-814c-528901e4872d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1441934481',owner_user_name='tempest-TestMinimumBasicScenario-1441934481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:48:23Z,user_data=None,user_id='8f875de7ee454dd4ad6918c6794941f1',uuid=c855e972-ae69-4b13-9b2f-6a588dbc3364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:49:08.595608 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converting VIF {"id": "a05fffde-eb69-4f28-8b37-639c483601f3", "address": "fa:16:3e:fe:d5:87", "network": {"id": "95a82fa9-7eba-4133-8586-c7f80d5df9e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-291173835-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6af4cde5a4934c1e8d619ec5b8c8adc9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05fffde-eb", "ovs_interfaceid": "a05fffde-eb69-4f28-8b37-639c483601f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:08.596714 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:08.596714 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:49:08.598924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.598924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa05fffde-eb, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:08.600230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.602955 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:08.603553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.603750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f514a60-c5e5-44a9-be4c-dfac80f12a1a) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:08.604543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.605942 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:08.608763 np0000000741 nova-compute[97948]: INFO os_vif [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d5:87,bridge_name='br-int',has_traffic_filtering=True,id=a05fffde-eb69-4f28-8b37-639c483601f3,network=Network(95a82fa9-7eba-4133-8586-c7f80d5df9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05fffde-eb')
May 14 03:49:08.608763 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Deleting instance files /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364_del
May 14 03:49:08.609868 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Deletion of /opt/stack/data/nova/instances/c855e972-ae69-4b13-9b2f-6a588dbc3364_del complete
May 14 03:49:08.900423 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:08.990467 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:08.992650 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730548.9923859, 52a6c262-080c-4a62-a33f-672d7dc93631 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:08.992839 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] VM Resumed (Lifecycle Event)
May 14 03:49:09.014404 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Took 16.83 seconds to build instance.
May 14 03:49:09.115773 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 03:49:09.116943 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:49:09.117158 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:49:09.117269 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:49:09.117486 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:09.196325 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:09.497497 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:09.499691 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:09.516034 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.342s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:09.556073 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8fdcc4e4-039a-403f-95cc-f47eba97049a req-978a1b36-8a3b-48d2-b76c-5ffad2ca7e00 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-deleted-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:09.556259 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-8fdcc4e4-039a-403f-95cc-f47eba97049a req-978a1b36-8a3b-48d2-b76c-5ffad2ca7e00 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Neutron deleted interface a05fffde-eb69-4f28-8b37-639c483601f3; detaching it from the instance and deleting it from the info cache
May 14 03:49:09.556420 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8fdcc4e4-039a-403f-95cc-f47eba97049a req-978a1b36-8a3b-48d2-b76c-5ffad2ca7e00 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:09.987539 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:10.003021 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99974817500015 future=<Future at 0x79d0b009dfa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:10.061270 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8fdcc4e4-039a-403f-95cc-f47eba97049a req-978a1b36-8a3b-48d2-b76c-5ffad2ca7e00 service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Detach interface failed, port_id=a05fffde-eb69-4f28-8b37-639c483601f3, reason: Instance c855e972-ae69-4b13-9b2f-6a588dbc3364 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:49:10.077455 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:10.080609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] Acquiring lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:10.080870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:10.081035 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:10.081227 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] No waiting events found dispatching network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:10.081444 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15515ba1-0a87-4983-9176-c5cea2fdebc6 req-8602f24c-c91d-4093-9ec8-80318e82130f service nova] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Received event network-vif-unplugged-a05fffde-eb69-4f28-8b37-639c483601f3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:10.489248 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Took 1.37 seconds to deallocate network for instance.
May 14 03:49:10.995170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:10.995523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:11.031384 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004260800001247844 future=<Future at 0x79d0b01b2810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:11.031924 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Emitting event <LifecycleEvent: 1778730536.0308375, 39304f73-2e21-43f5-a634-2e1f42124be5 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:11.032078 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] VM Stopped (Lifecycle Event)
May 14 03:49:11.034254 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:11.034254 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.968852014999811 future=<Future at 0x79d0b009dfa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:11.034254 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.968769803999749 future=<Future at 0x79d0b009dfa0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:11.278806 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:11.278806 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:11.534793 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 39304f73-2e21-43f5-a634-2e1f42124be5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:11.620706 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-changed-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:11.621729 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Refreshing instance network info cache due to event network-changed-8fbaa006-9713-415d-ad49-5c00dcac3f8a. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:11.621915 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] Acquiring lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:11.622086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] Acquired lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:11.622223 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Refreshing network info cache for port 8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:11.783378 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:12.124762 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:12.294610 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.297s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:12.364314 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Deleted allocations for instance c855e972-ae69-4b13-9b2f-6a588dbc3364
May 14 03:49:12.482785 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:12.665986 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updated VIF entry in instance network info cache for port 8fbaa006-9713-415d-ad49-5c00dcac3f8a. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:12.666297 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating instance_info_cache with network_info: [{"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:13.168059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-93faf08d-0e1a-4c9a-a45b-8b39fd1bfefb req-6b5fec06-1bff-4e7d-b678-138ea0232b20 service nova] Releasing lock "refresh_cache-52a6c262-080c-4a62-a33f-672d7dc93631" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:13.372732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9f46ba01-dda6-4eb7-9342-b0f3e64c4439 tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Lock "c855e972-ae69-4b13-9b2f-6a588dbc3364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.146s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:13.605713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:13.901514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:15.474940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:15.474940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:15.474940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:15.474940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:15.474940 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:15.477185 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Terminating instance
May 14 03:49:15.678523 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:15.979446 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:49:16.002619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.005190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.043670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.065566 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.071314 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.166095 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:16.166279 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:16.166437 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:16.166554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:16.166892 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] No waiting events found dispatching network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:16.167002 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-105bfeaa-feca-4546-9aa4-129c1ad7dff7 req-4ddd2a7a-eb44-4055-86b1-9f6f0e7b868b service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:16.310430 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999509486000079 future=<Future at 0x79d0b071f170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:16.311614 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Instance destroyed successfully.
May 14 03:49:16.311993 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid c91d7618-3b0d-4cdd-94b4-61424a502c3f {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:16.814480 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-20490568',display_name='tempest-TestVolumeBootPattern-server-20490568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-20490568',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:48:35Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-9ighn21w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:48:36Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=c91d7618-3b0d-4cdd-94b4-61424a502c3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:49:16.815016 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "92068630-02d8-4706-aaa7-f5109f99c04d", "address": "fa:16:3e:79:1d:6e", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92068630-02", "ovs_interfaceid": "92068630-02d8-4706-aaa7-f5109f99c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:16.815102 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:16.815292 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:49:16.816139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.816360 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92068630-02, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:16.817303 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.818030 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:16.819369 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.819970 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.820116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e50e797e-948e-4fcb-afec-de091881ddd4) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:16.820539 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:16.821112 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:16.824117 np0000000741 nova-compute[97948]: INFO os_vif [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=92068630-02d8-4706-aaa7-f5109f99c04d,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92068630-02')
May 14 03:49:16.825534 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:49:16.825819 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:16.825966 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:16.826291 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:16.826594 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:49:16.826746 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:49:16.849984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:16.849984 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:16.849984 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:16.849984 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:16.849984 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:16.850212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:16.850212 np0000000741 nova-compute[97948]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:16.850212 np0000000741 nova-compute[97948]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:16.850212 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:16.850212 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:16.850212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '178')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:49:16.850388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '171')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:16.851167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '172')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:16.851884 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b815e200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:49:16.852105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:49:16.852338 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000afbfdd02 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:49:16.899859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:16.949077 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:17.004412 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:49:17.004652 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:49:17.005718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:49:17.017664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:49:17.017664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:49:17.029784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.069323 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260]
May 14 03:49:17.069323 np0000000741 nova-compute[97948]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260] successful.
May 14 03:49:17.069323 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.084926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.097583 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.124914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260]
May 14 03:49:17.124914 np0000000741 nova-compute[97948]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260] successful.
May 14 03:49:17.124914 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.136728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:17.136978 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:17.137067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (311ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:17.137177 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:49:17.137434 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Deleting instance files /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f_del
May 14 03:49:17.137934 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Deletion of /opt/stack/data/nova/instances/c91d7618-3b0d-4cdd-94b4-61424a502c3f_del complete
May 14 03:49:17.489847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:17.644663 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Took 1.66 seconds to destroy the instance on the hypervisor.
May 14 03:49:17.645337 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:49:17.645682 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:49:17.645766 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:49:17.645977 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:17.727571 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:18.252513 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6aba5ffc-4cff-4151-a36a-a23d3565b455 req-c08a5d80-2982-40da-814d-231963d9634f service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-deleted-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:18.252908 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-6aba5ffc-4cff-4151-a36a-a23d3565b455 req-c08a5d80-2982-40da-814d-231963d9634f service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Neutron deleted interface 92068630-02d8-4706-aaa7-f5109f99c04d; detaching it from the instance and deleting it from the info cache
May 14 03:49:18.252908 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6aba5ffc-4cff-4151-a36a-a23d3565b455 req-c08a5d80-2982-40da-814d-231963d9634f service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:18.255797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:18.256625 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] Acquiring lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:18.256777 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:18.256949 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:18.257128 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] No waiting events found dispatching network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:18.257285 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a2bef94c-7311-43fe-867d-516a09934209 req-17a82e79-4c90-4ca8-9b95-9c810b1290ca service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Received event network-vif-unplugged-92068630-02d8-4706-aaa7-f5109f99c04d for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:18.701447 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:18.758855 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6aba5ffc-4cff-4151-a36a-a23d3565b455 req-c08a5d80-2982-40da-814d-231963d9634f service nova] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Detach interface failed, port_id=92068630-02d8-4706-aaa7-f5109f99c04d, reason: Instance c91d7618-3b0d-4cdd-94b4-61424a502c3f could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:49:18.903729 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:19.202814 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Took 1.56 seconds to deallocate network for instance.
May 14 03:49:19.751389 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:49:20.259609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:20.260048 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:20.442404 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:20.442803 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:20.947702 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:21.172736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:21.453377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.193s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:21.514666 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance c91d7618-3b0d-4cdd-94b4-61424a502c3f
May 14 03:49:21.821680 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:22.523030 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-eb24ba16-fe46-4501-a610-798bd785c673 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "c91d7618-3b0d-4cdd-94b4-61424a502c3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.050s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:23.907480 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:24.713660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:24.713891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:25.003567 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0007767199999761942 future=<Future at 0x79d0b009dfa0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:25.004155 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730550.0026813, c855e972-ae69-4b13-9b2f-6a588dbc3364 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:25.004296 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:25.004509 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] VM Stopped (Lifecycle Event)
May 14 03:49:25.005604 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.304225846999998 future=<Future at 0x79d0b071f170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:25.005680 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=6.304104633999941 future=<Future at 0x79d0b071f170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:25.216904 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:49:25.507115 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: c855e972-ae69-4b13-9b2f-6a588dbc3364] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:25.783570 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:25.783892 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:25.788057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:25.788215 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:25.791243 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:49:25.791431 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Claim successful on node np0000000741
May 14 03:49:26.783539 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:26.784087 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:26.823865 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:26.998192 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:26.998384 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:27.192907 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:27.501241 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:28.009780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:28.010147 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:49:28.517553 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:49:28.521064 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:49:28.521064 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:28.521064 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:28.609727 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:49:28.908882 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:29.023264 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:49:29.073693 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:29.133623 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Successfully created port: a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:49:29.530612 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:49:29.783313 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:29.783735 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:29.948006 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Successfully updated port: a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:49:30.002938 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:30.003495 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing instance network info cache due to event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:30.003756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] Acquiring lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:30.003946 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] Acquired lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:30.004186 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing network info cache for port a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:30.040537 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Booting with volume 53aefc7f-07a2-4196-9807-3e01796cb61c at /dev/vda
May 14 03:49:30.077159 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:30.087063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:49:30.108856 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:30.160480 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:49:30.160749 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:49:30.171031 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:49:30.171929 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fea7:37cc', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fe6d:7285', 'fe80::34ec:6bff:feb3:d1f'] 
May 14 03:49:30.172088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:49:30.172183 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:49:30.172408 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:30.172591 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating existing volume attachment record: ea3a10b4-faf0-439f-b123-d751e33ef2d5 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:49:30.450120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:30.478075 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:30.478543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:30.478731 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:30.478857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:30.479063 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] No waiting events found dispatching network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:30.479092 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0fbb5723-f66a-4388-a04e-3928504e985f req-7b946970-76c9-4fda-b116-43f49f284885 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received unexpected event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 for instance with vm_state building and task_state block_device_mapping.
May 14 03:49:30.511400 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:30.576812 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:49:30.704566 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:30.783460 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:30.784922 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:49:30.784922 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:31.207592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d88923fe-4c9c-4819-9001-dc0262587249 req-bbb92868-430e-4331-8171-7218be376672 service nova] Releasing lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:31.208093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:31.208344 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:49:31.310450 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005472259999805829 future=<Future at 0x79d0b071f170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:31.310879 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730556.309741, c91d7618-3b0d-4cdd-94b4-61424a502c3f => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:31.311036 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:31.311167 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] VM Stopped (Lifecycle Event)
May 14 03:49:31.570523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:31.570726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:31.770900 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:49:31.815595 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: c91d7618-3b0d-4cdd-94b4-61424a502c3f] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:31.830668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:31.929222 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:32.050795 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:32.072556 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:49:32.262611 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:49:32.263579 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:49:32.263813 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Creating image(s)
May 14 03:49:32.264120 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:49:32.264234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Ensure instance console log exists: /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:49:32.264457 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:32.264604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:32.264722 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:32.552615 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:32.552866 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance network_info: |[{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:49:32.553438 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Start _get_guest_xml network_info=[{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6b67511f-42d0-418f-8315-3072389f618b', 'attached_at': '', 'detached_at': '', 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'serial': '53aefc7f-07a2-4196-9807-3e01796cb61c'}, 'boot_index': 0, 'attachment_id': 'ea3a10b4-faf0-439f-b123-d751e33ef2d5', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:49:32.558373 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:49:32.559560 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-248102859', uuid='6b67511f-42d0-418f-8315-3072389f618b'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730572.5591671) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:49:32.561081 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:49:32.561489 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:49:32.562824 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:49:32.562998 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:49:32.564170 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:49:32.564408 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:49:32.564574 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:49:32.564627 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:49:32.564741 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:49:32.564839 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:49:32.564987 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:49:32.565205 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:49:32.565317 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:49:32.565433 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:49:32.565524 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:49:32.565705 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:49:32.575846 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:49:32.576120 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:32.576275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:32.579395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:32.579589 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:49:32.592055 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:32.593516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:32.593937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:32.594157 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:49:32.594611 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:32.594813 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:49:32.605805 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:49:32.605805 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:32.612372 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:49:32.612372 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:32.617993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c] added
May 14 03:49:32.617993 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:49:32.617993 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:32.617993 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:32.617993 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:32.617993 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:32.617993 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:32.618184 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:49:32.618365 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:49:32.618809 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:49:32.623625 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c] added
May 14 03:49:32.623625 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:49:32.623625 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:32.623625 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:32.623625 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:32.623625 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:32.623625 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:32.623889 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:49:32.624020 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:49:32.624189 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:49:32.632528 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:32.632768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:32.636276 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:49:32.636403 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Claim successful on node np0000000741
May 14 03:49:32.783189 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:33.287046 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:33.619000 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:49:33.624534 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:49:33.629899 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:49:33.629899 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:49:33.635078 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:49:33.635078 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.641939 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.650153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.654917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.654917 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.654917 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:33.655083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.655083 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.655083 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:33.661357 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.661357 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.661357 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:33.661549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.661549 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.661549 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:33.683842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260]
May 14 03:49:33.683842 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260] successful.
May 14 03:49:33.683842 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.695164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.704024 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260]
May 14 03:49:33.704024 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260] successful.
May 14 03:49:33.704024 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.708738 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:33.709040 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:33.709175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:49:33.709927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('7', '-', '-', 0) found on session 179 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:49:33.710064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:49:33.715997 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:33.726561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 179 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:33.726561 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:49:33.728814 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.728814 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.728814 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.728814 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.728814 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:33.728984 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.728984 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:33.728984 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.728984 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:33.728984 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:33.729129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:33.729194 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:49:33.729715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('8', '-', '-', 0) found on session 180 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:49:33.729806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:49:33.743895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 180 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:33.743895 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:49:33.881472 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:33.881772 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:33.911512 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:34.388873 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:34.594788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:49:34.896598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.264s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:34.896899 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:49:34.898832 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.612s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:34.899149 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:34.900150 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:49:35.404738 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:49:35.405179 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:49:35.405179 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:35.405535 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:35.483699 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54283c49dc2245a393345e5b881bff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d6f0014a3d247b496b2a4a9181936b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:49:35.558227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:35.558227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:35.611941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000afbfdd02 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:49:35.612348 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:35.612548 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000afbfdd02', 'path': '/dev/dm-0', 'multipath_id': '330000000afbfdd02'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:35.612754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000afbfdd02', 'path': '/dev/dm-0', 'multipath_id': '330000000afbfdd02'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:49:35.907549 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:49:35.934893 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:49:35.937345 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Successfully created port: 6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:49:35.939980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:36.051269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:36.051702 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:36.073207 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:36.120651 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-248102859',display_name='tempest-TestVolumeBootPattern-server-248102859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-248102859',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-f2ek4b8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:49:30Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=6b67511f-42d0-418f-8315-3072389f618b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:49:36.120651 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:36.120651 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:36.121287 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b67511f-42d0-418f-8315-3072389f618b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:36.144973 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:36.148777 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:49:36.149748 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:36.201878 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:36.202286 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13417MB free_disk=72.74618911743164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:49:36.202441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:36.202720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:36.411262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:49:36.448462 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Successfully updated port: 6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:49:36.498242 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-changed-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:36.498382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Refreshing instance network info cache due to event network-changed-6e282dad-971a-4b48-8fb7-29806f783939. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:36.498594 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] Acquiring lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:36.499052 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] Acquired lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:36.499233 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Refreshing network info cache for port 6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:36.624698 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <uuid>6b67511f-42d0-418f-8315-3072389f618b</uuid>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <name>instance-00000047</name>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-248102859</nova:name>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:49:32</nova:creationTime>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         <nova:port uuid="a7da705c-d6d0-45a4-ab6c-b23990888769">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <system>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="serial">6b67511f-42d0-418f-8315-3072389f618b</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="uuid">6b67511f-42d0-418f-8315-3072389f618b</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </system>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <os>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </os>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <features>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </features>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   <devices>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/disk.config"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <alias name="ua-53aefc7f-07a2-4196-9807-3e01796cb61c"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <serial>53aefc7f-07a2-4196-9807-3e01796cb61c</serial>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:87:a6:ae"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <target dev="tapa7da705c-d6"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </interface>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/console.log" append="off"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </serial>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <video>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </video>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </rng>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:   </devices>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]: </domain>
May 14 03:49:36.624698 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:49:36.624698 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Preparing to wait for external event network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-248102859',display_name='tempest-TestVolumeBootPattern-server-248102859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-248102859',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-f2ek4b8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:49:30Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=6b67511f-42d0-418f-8315-3072389f618b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:49:36.627876 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.628234 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:36.628349 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:49:36.629371 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.629532 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10fa22da-5626-5f4e-baa1-fcf376613fda', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:36.630684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.631861 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:36.634025 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.634308 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7da705c-d6, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:36.634728 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7da705c-d6, col_values=(('qos', UUID('24ab26a0-8a18-44ce-be1e-ee87f3e29748')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:36.634932 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7da705c-d6, col_values=(('external_ids', {'iface-id': 'a7da705c-d6d0-45a4-ab6c-b23990888769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:a6:ae', 'vm-uuid': '6b67511f-42d0-418f-8315-3072389f618b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:36.635886 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.636923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:36.642255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:36.643231 np0000000741 nova-compute[97948]: INFO os_vif [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6')
May 14 03:49:36.956255 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:37.003651 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:37.062512 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:49:37.082330 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:37.208788 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:37.281174 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:49:37.281327 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 52a6c262-080c-4a62-a33f-672d7dc93631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:49:37.281487 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 6b67511f-42d0-418f-8315-3072389f618b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:49:37.281679 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 076da36f-3685-4e03-b748-e158fb0c9c00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:49:37.281904 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:49:37.282107 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:49:36 up 41 min,  2 users,  load average: 5.31, 5.85, 4.84\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_43df7b9472f445dfbf816cb9b648332e': '1', 'io_workload': '2', 'num_proj_71fb53bd4f2841db99df994d7e6c2a72': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '1', 'num_task_networking': '1', 'num_proj_5d6f0014a3d247b496b2a4a9181936b0': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:49:37.423362 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:49:37.425132 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:49:37.425132 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Creating image(s)
May 14 03:49:37.425473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:37.425668 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:37.426114 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:37.426816 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:49:37.429524 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:49:37.430806 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:37.544495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.114s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:37.545410 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:37.549591 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:37.553249 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:49:37.557092 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:49:37.557535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:37.610358 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:37.610711 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:37.658765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.101s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:37.659040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:37.711415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-009fed94-dda8-4683-ab07-a7b8194de738 req-43a39da0-b1c3-433f-9375-b8375d4e0f18 service nova] Releasing lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:37.713009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquired lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:37.713204 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:49:37.724214 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk 1073741824" returned: 0 in 0.065s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:37.724813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:37.725104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:37.827490 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.102s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:37.827897 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:49:37.828139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:37.919215 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:37.919759 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Cannot resize image /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:49:37.920310 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:49:37.920609 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Ensure instance console log exists: /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:49:37.921095 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:37.921547 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:37.921765 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:38.116463 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:38.163481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:38.163659 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:38.163816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:87:a6:ae, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:49:38.164323 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Using config drive
May 14 03:49:38.181427 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:38.182186 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:38.182424 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Attaching volume 4c2be7a2-15f2-4121-bc11-50f890cd17e2 to /dev/vdb
May 14 03:49:38.228935 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:38.240107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:49:38.263723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:38.298801 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:49:38.321211 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:49:38.321575 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:49:38.330937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:49:38.332325 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fea7:37cc', 'fe80::301d:fdff:fe12:5c43', 'fe80::fc16:3eff:fe6d:7285', 'fe80::34ec:6bff:feb3:d1f'] 
May 14 03:49:38.332514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:49:38.332702 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:49:38.333049 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:38.333386 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating existing volume attachment record: 865ec20f-c02b-49b3-b862-d5aa7727b321 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:49:38.452215 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:38.582512 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating instance_info_cache with network_info: [{"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:38.626927 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:49:38.627306 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.424s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:38.628031 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:38.672341 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:38.803591 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Creating config drive at /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/disk.config
May 14 03:49:38.806568 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqsmtj9yy {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:38.859484 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqsmtj9yy" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:38.912670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:38.928509 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1c4c59c3-660c-4f36-b589-af95eb8924f5', 'attached_at': '', 'detached_at': '', 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'serial': '4c2be7a2-15f2-4121-bc11-50f890cd17e2'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:49:38.931914 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:49:38.931914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:38.931914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:38.931914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:38.931914 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:49:38.944751 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:38.945198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:38.945844 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:38.947053 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:49:38.947405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:38.947584 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:49:38.959102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:49:38.959102 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:38.961012 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:49:38.961012 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:38.973009 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2] added
May 14 03:49:38.973009 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:49:38.973009 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:38.973009 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:38.973009 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:38.973009 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:38.973009 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:38.973252 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:49:38.973435 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:49:38.973662 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:49:38.976167 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2] added
May 14 03:49:38.976167 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:49:38.976167 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:38.976167 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:38.976167 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:49:38.976167 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:49:38.976167 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:38.976332 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:49:38.976581 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:49:38.976767 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:49:39.084866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Releasing lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:39.085458 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance network_info: |[{"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:49:39.088067 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Start _get_guest_xml network_info=[{"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:49:39.091868 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:49:39.093286 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825', uuid='076da36f-3685-4e03-b748-e158fb0c9c00'), owner=OwnerMeta(userid='54283c49dc2245a393345e5b881bff95', username='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member', projectid='5d6f0014a3d247b496b2a4a9181936b0', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730579.0928752) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:49:39.095178 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:49:39.095587 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:49:39.098106 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:49:39.098483 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:49:39.099875 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:49:39.100531 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:49:39.101095 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:49:39.101095 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:49:39.101766 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:49:39.101766 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:49:39.101766 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:49:39.101994 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:49:39.102027 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:49:39.102221 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:49:39.102325 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:49:39.103209 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:49:39.118932 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachscenariooldversion-server-1330432',id=72,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN1b5rR6WLACt9VRpqF1hj9rNNAEljV2pDPKLr7n9AzV4jtwEJgCJobpOuW0U69ljE4PzOzLiBqIQiTbJ/w9KS5QHadwQCxauaejESIcFmV2yJrB9eZjGIGAz4PLol7jg==',key_name='tempest-keypair-693589667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d6f0014a3d247b496b2a4a9181936b0',ramdisk_id='',reservation_id='r-k44ua4j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54283c49dc2245a393345e5b881bff95',uuid=076da36f-3685-4e03-b748-e158fb0c9c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:49:39.119173 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converting VIF {"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:39.119947 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:39.120670 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lazy-loading 'pci_devices' on Instance uuid 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:39.287109 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.314389 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.390977 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.432984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4696bedf-6cb2-4dbc-be27-bfe23e1e341f req-f6dbde4f-a811-49b2-8e56-d81cd022ea52 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:39.433186 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4696bedf-6cb2-4dbc-be27-bfe23e1e341f req-f6dbde4f-a811-49b2-8e56-d81cd022ea52 service nova] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:39.433314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4696bedf-6cb2-4dbc-be27-bfe23e1e341f req-f6dbde4f-a811-49b2-8e56-d81cd022ea52 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:39.433435 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4696bedf-6cb2-4dbc-be27-bfe23e1e341f req-f6dbde4f-a811-49b2-8e56-d81cd022ea52 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:39.433549 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4696bedf-6cb2-4dbc-be27-bfe23e1e341f req-f6dbde4f-a811-49b2-8e56-d81cd022ea52 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Processing event network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:49:39.534545 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.537334 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.538387 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.556736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.624446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] End _get_guest_xml xml=<domain type="qemu">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <uuid>076da36f-3685-4e03-b748-e158fb0c9c00</uuid>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <name>instance-00000048</name>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825</nova:name>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:49:39</nova:creationTime>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:user uuid="54283c49dc2245a393345e5b881bff95">tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member</nova:user>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:project uuid="5d6f0014a3d247b496b2a4a9181936b0">tempest-TestServerVolumeAttachScenarioOldVersion-1000356356</nova:project>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         <nova:port uuid="6e282dad-971a-4b48-8fb7-29806f783939">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <system>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="serial">076da36f-3685-4e03-b748-e158fb0c9c00</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="uuid">076da36f-3685-4e03-b748-e158fb0c9c00</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </system>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <os>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </os>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <features>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </features>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   <devices>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.config"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </disk>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:90:ce:2d"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <target dev="tap6e282dad-97"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </interface>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/console.log" append="off"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </serial>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <video>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </video>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </rng>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:   </devices>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]: </domain>
May 14 03:49:39.624446 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Preparing to wait for external event network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachscenariooldversion-server-1330432',id=72,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN1b5rR6WLACt9VRpqF1hj9rNNAEljV2pDPKLr7n9AzV4jtwEJgCJobpOuW0U69ljE4PzOzLiBqIQiTbJ/w9KS5QHadwQCxauaejESIcFmV2yJrB9eZjGIGAz4PLol7jg==',key_name='tempest-keypair-693589667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d6f0014a3d247b496b2a4a9181936b0',ramdisk_id='',reservation_id='r-k44ua4j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54283c49dc2245a393345e5b881bff95',uuid=076da36f-3685-4e03-b748-e158fb0c9c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converting VIF {"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:39.626487 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:49:39.626904 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.626904 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:39.627071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:49:39.627586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.627755 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7a6a1e8-1b9a-5892-aee9-7ac958717e5a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:39.628272 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:39.628574 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.629400 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:39.629514 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.629748 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:49:39.630462 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.15 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:49:39.631375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.631488 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e282dad-97, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:39.631750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e282dad-97, col_values=(('qos', UUID('ef919e61-dd2b-43cb-ba57-3a4c1dad3014')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:39.631887 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e282dad-97, col_values=(('external_ids', {'iface-id': '6e282dad-971a-4b48-8fb7-29806f783939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ce:2d', 'vm-uuid': '076da36f-3685-4e03-b748-e158fb0c9c00'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:39.632439 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.633395 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:39.637840 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:39.638419 np0000000741 nova-compute[97948]: INFO os_vif [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97')
May 14 03:49:39.931542 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730579.931085, 6b67511f-42d0-418f-8315-3072389f618b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:39.932022 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:49:39.932275 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] VM Started (Lifecycle Event)
May 14 03:49:39.934555 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:49:39.936465 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance spawned successfully.
May 14 03:49:39.937667 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:49:39.974126 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:49:39.977129 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:49:39.986074 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:49:39.986074 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:49:39.993712 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:49:39.993712 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.000617 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.007050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.013181 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:40.019912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.019912 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.019912 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.019912 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.019912 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:40.020093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.020093 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.020093 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.020093 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.020093 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:40.055732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.50.100,3260]
May 14 03:49:40.055732 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.50.100,3260] successful.
May 14 03:49:40.055732 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.068993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.070123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.40.100,3260]
May 14 03:49:40.070123 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.40.100,3260] successful.
May 14 03:49:40.070123 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.086369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.091483 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.093510 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('10', '-', '-', 0) found on session 181 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:49:40.093510 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:40.110405 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] HCTL ('11', '-', '-', 0) found on session 182 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 181 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:40.110405 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:49:40.126294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Searching for a device in session 182 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:49:40.126294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:49:40.434870 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:40.436775 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:40.444982 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.445090 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.445571 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.445829 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.446205 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.446746 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:40.940791 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:49:40.941198 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730580.9408932, 6b67511f-42d0-418f-8315-3072389f618b => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:40.941198 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] VM Paused (Lifecycle Event)
May 14 03:49:40.947198 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:49:40.952080 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Took 8.69 seconds to spawn the instance on the hypervisor.
May 14 03:49:40.952274 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:41.154960 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:41.155096 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:41.155282 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No VIF found with MAC fa:16:3e:90:ce:2d, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:49:41.155785 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Using config drive
May 14 03:49:41.446056 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:41.448224 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730581.4479635, 6b67511f-42d0-418f-8315-3072389f618b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:41.448387 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] VM Resumed (Lifecycle Event)
May 14 03:49:41.465439 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Took 15.74 seconds to build instance.
May 14 03:49:41.488077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:41.488453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:41.488663 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:41.488922 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:41.489121 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] No waiting events found dispatching network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:41.489285 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-eeb68df5-e92d-4eb4-9186-c3dadb202ab2 req-c979bd9a-0950-4959-ac4c-80e425b0e5b7 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received unexpected event network-vif-plugged-a7da705c-d6d0-45a4-ab6c-b23990888769 for instance with vm_state active and task_state None.
May 14 03:49:41.661298 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:41.788812 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Creating config drive at /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.config
May 14 03:49:41.793160 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5vklxqk {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:49:41.855613 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg5vklxqk" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:49:41.954387 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:41.964141 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:41.966596 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found WWN 330000000982887aa for multipath device dm-4 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:49:41.970660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a3906d0d-f808-476c-b491-c70581a27cdc tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.253s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:41.970660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:41.970660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000982887aa', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000982887aa'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:41.970660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000982887aa', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000982887aa'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:49:41.973746 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:49:41.974057 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:41.974284 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:41.975181 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x79d0b84c8680>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1c4c59c3-660c-4f36-b589-af95eb8924f5', 'attached_at': '', 'detached_at': '', 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'serial': '4c2be7a2-15f2-4121-bc11-50f890cd17e2'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:49:41.975181 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97948) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 03:49:41.975394 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] opening encrypted volume /dev/dm-4 {{(pid=97948) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 03:49:42.018827 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.luks [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 03:49:42.018990 np0000000741 nova-compute[97948]: INFO os_brick.encryptors.luks [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] /dev/dm-4 is not a valid LUKS device; formatting device for first use
May 14 03:49:42.019059 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] formatting encrypted volume /dev/dm-4 {{(pid=97948) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 03:49:42.279725 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.307045 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.406309 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.624564 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.626554 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.638597 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:42.658160 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:43.183651 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730583.1832976, 076da36f-3685-4e03-b748-e158fb0c9c00 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:43.184033 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] VM Started (Lifecycle Event)
May 14 03:49:43.582087 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:43.582719 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:43.582936 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:43.583123 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:43.583271 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Processing event network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:49:43.583442 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:43.583591 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:43.583762 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:43.583899 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:43.584040 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] No waiting events found dispatching network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:43.584454 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:49:43.584617 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received unexpected event network-vif-plugged-6e282dad-971a-4b48-8fb7-29806f783939 for instance with vm_state building and task_state spawning.
May 14 03:49:43.584773 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:43.584920 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing instance network info cache due to event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:43.585099 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Acquiring lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:43.585406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Acquired lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:43.585582 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing network info cache for port a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:43.598568 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:49:43.602829 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance spawned successfully.
May 14 03:49:43.610828 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:49:43.686437 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:43.693656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:43.928093 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:44.096725 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:44.132896 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.133025 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.133412 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.133616 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.133920 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.134188 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:49:44.198728 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:49:44.198728 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730584.1973765, 076da36f-3685-4e03-b748-e158fb0c9c00 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:44.198728 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] VM Paused (Lifecycle Event)
May 14 03:49:44.558327 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:44.643997 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Took 7.22 seconds to spawn the instance on the hypervisor.
May 14 03:49:44.646364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:44.647302 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:44.703586 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:44.712937 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730584.7090611, 076da36f-3685-4e03-b748-e158fb0c9c00 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:49:44.712937 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] VM Resumed (Lifecycle Event)
May 14 03:49:44.724542 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updated VIF entry in instance network info cache for port a7da705c-d6d0-45a4-ab6c-b23990888769. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:44.724868 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:45.167579 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Took 12.59 seconds to build instance.
May 14 03:49:45.215526 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:49:45.218893 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:49:45.227143 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-68f6c5c5-1046-4f3b-b035-473ce5fdc658 req-24e42213-3726-4848-8b7d-918eac146aac service nova] Releasing lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:45.668714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.098s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:46.363083 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-changed-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:46.363444 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Refreshing instance network info cache due to event network-changed-6e282dad-971a-4b48-8fb7-29806f783939. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:49:46.363752 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] Acquiring lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:49:46.363894 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] Acquired lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:49:46.364065 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Refreshing network info cache for port 6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:49:46.866614 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:47.349614 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:47.557482 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updated VIF entry in instance network info cache for port 6e282dad-971a-4b48-8fb7-29806f783939. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:49:47.558542 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating instance_info_cache with network_info: [{"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:48.067022 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95fbcfce-3173-4b84-9de2-d30d5684bf09 req-1df0c628-5abe-4310-b5aa-201f5fe52cdb service nova] Releasing lock "refresh_cache-076da36f-3685-4e03-b748-e158fb0c9c00" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:49:48.319278 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:48.319574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:48.319893 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:48.320167 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:48.320358 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:48.333176 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Terminating instance
May 14 03:49:48.838623 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:49:48.862923 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:48.866522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:48.897393 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:48.925899 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:48.939325 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:49.072433 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:49.074933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:49.075406 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:49.075909 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:49.075909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] No waiting events found dispatching network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:49.075909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-263ab9c8-f58a-44d1-9e55-7b21eebb56ab req-d56d244c-a07e-4ef0-be2e-f20605700400 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:49.197459 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999606764999953 future=<Future at 0x79d090733f80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:49.202156 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.994907216999763 future=<Future at 0x79d090733f80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:49.202297 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.994720012000016 future=<Future at 0x79d090733f80 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:49:49.203205 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Instance destroyed successfully.
May 14 03:49:49.204041 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'resources' on Instance uuid 52a6c262-080c-4a62-a33f-672d7dc93631 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:49.649627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:49.710827 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-522319185',display_name='tempest-TestEncryptedCinderVolumes-server-522319185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-522319185',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:49:08Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-lljpclpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:49:09Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=52a6c262-080c-4a62-a33f-672d7dc93631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:49:49.710827 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "address": "fa:16:3e:6d:72:85", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbaa006-97", "ovs_interfaceid": "8fbaa006-9713-415d-ad49-5c00dcac3f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:49:49.710827 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:49:49.711233 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:49:49.713619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:49.717098 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbaa006-97, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:49.719294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:49.720417 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:49.722729 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:49.722948 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b54d447-ad61-497a-a2f4-f8c8e75ca1ad) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:49:49.725140 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:49:49.732470 np0000000741 nova-compute[97948]: INFO os_vif [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:72:85,bridge_name='br-int',has_traffic_filtering=True,id=8fbaa006-9713-415d-ad49-5c00dcac3f8a,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbaa006-97')
May 14 03:49:49.739872 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:49:49.740259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:49.740531 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:49.742085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:49.742964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c63867b8-f5cb-455a-9f57-59a0149d4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:49:49.743064 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:49.776658 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '182')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '177')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586', '178')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01edc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Removing multipathed devices sdd, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:49:49.780877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flush multipath device 3300000006b217f3e {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:49:49.817480 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:49.866134 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:49.922335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:49:49.922547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:49:49.925155 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:49:49.948000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:49:49.948144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:49:49.963113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:49.998956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.40.100,3260]
May 14 03:49:49.998956 np0000000741 nova-compute[97948]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.40.100,3260] successful.
May 14 03:49:49.998956 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:50.020127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:50.038418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:50.071313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.50.100,3260]
May 14 03:49:50.071313 np0000000741 nova-compute[97948]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-c63867b8-f5cb-455a-9f57-59a0149d4586, portal: 192.168.50.100,3260] successful.
May 14 03:49:50.071313 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:50.091899 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:50.095740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:50.095995 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== disconnect_volume: return (355ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:50.096128 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:49:50.096549 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Deleting instance files /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631_del
May 14 03:49:50.097197 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Deletion of /opt/stack/data/nova/instances/52a6c262-080c-4a62-a33f-672d7dc93631_del complete
May 14 03:49:50.603828 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Took 1.76 seconds to destroy the instance on the hypervisor.
May 14 03:49:50.604587 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:49:50.604996 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:49:50.605127 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:49:50.605369 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:50.667955 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] opening encrypted volume /dev/dm-4 {{(pid=97948) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 03:49:50.688220 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:49:51.190586 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:51.191009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] Acquiring lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:51.191009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:51.191009 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] Lock "52a6c262-080c-4a62-a33f-672d7dc93631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:51.191135 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] No waiting events found dispatching network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:49:51.191237 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8463bcf7-0b96-43de-8da4-5e49828ab7ac req-8b8be5f5-79e5-4609-aeb9-5f3f4cb0e8d0 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-unplugged-8fbaa006-9713-415d-ad49-5c00dcac3f8a for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:49:51.214040 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c07e6b8-1e29-4ca5-8e70-aca2d8a9ce1f req-af7efcef-1dd1-4daf-a39d-abf796db9088 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Received event network-vif-deleted-8fbaa006-9713-415d-ad49-5c00dcac3f8a {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:49:51.214508 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-0c07e6b8-1e29-4ca5-8e70-aca2d8a9ce1f req-af7efcef-1dd1-4daf-a39d-abf796db9088 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Neutron deleted interface 8fbaa006-9713-415d-ad49-5c00dcac3f8a; detaching it from the instance and deleting it from the info cache
May 14 03:49:51.214715 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-0c07e6b8-1e29-4ca5-8e70-aca2d8a9ce1f req-af7efcef-1dd1-4daf-a39d-abf796db9088 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:51.642824 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:49:51.721191 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0c07e6b8-1e29-4ca5-8e70-aca2d8a9ce1f req-af7efcef-1dd1-4daf-a39d-abf796db9088 service nova] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Detach interface failed, port_id=8fbaa006-9713-415d-ad49-5c00dcac3f8a, reason: Instance 52a6c262-080c-4a62-a33f-672d7dc93631 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:49:51.958135 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:52.145231 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Took 1.54 seconds to deallocate network for instance.
May 14 03:49:52.711464 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Took 0.57 seconds to detach 1 volumes for instance.
May 14 03:49:53.073783 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:49:53.217422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:53.217608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:53.477818 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:49:53.478014 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:49:53.576755 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Attempting to attach volume 4c2be7a2-15f2-4121-bc11-50f890cd17e2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:49:53.578264 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:   <alias name="ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2"/>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:   <serial>4c2be7a2-15f2-4121-bc11-50f890cd17e2</serial>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]: </disk>
May 14 03:49:53.578264 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:49:53.948538 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:53.981313 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:49:54.487941 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.270s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:54.567229 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deleted allocations for instance 52a6c262-080c-4a62-a33f-672d7dc93631
May 14 03:49:54.724039 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:55.245931 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:55.246393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:55.246393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:49:55.246393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] No VIF found with MAC fa:16:3e:a7:37:cc, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:49:55.457375 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:55.576458 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-94bdc09f-dff8-4186-a1c1-db725773884e tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "52a6c262-080c-4a62-a33f-672d7dc93631" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.257s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:56.802619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ac1599b-0684-4648-9414-4b42c420a5f1 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.620s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:49:57.634300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:49:57.634300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:49:58.136055 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Detaching volume 4c2be7a2-15f2-4121-bc11-50f890cd17e2
May 14 03:49:58.177257 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Attempting to driver detach volume 4c2be7a2-15f2-4121-bc11-50f890cd17e2 from mountpoint /dev/vdb
May 14 03:49:58.207753 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1c4c59c3-660c-4f36-b589-af95eb8924f5', 'attached_at': '', 'detached_at': '', 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'serial': '4c2be7a2-15f2-4121-bc11-50f890cd17e2'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:49:58.209728 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:49:58.211554 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Found disk vdb by alias ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:49:58.211754 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Attempting to detach device vdb from instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:49:58.212080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <alias name="ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2"/>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <serial>4c2be7a2-15f2-4121-bc11-50f890cd17e2</serial>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]: </disk>
May 14 03:49:58.212080 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:49:58.219512 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 from the persistent domain config.
May 14 03:49:58.219765 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] (1/8): Attempting to detach device vdb with device alias ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2 from instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:49:58.219994 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <alias name="ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2"/>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <serial>4c2be7a2-15f2-4121-bc11-50f890cd17e2</serial>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]: </disk>
May 14 03:49:58.219994 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:49:58.377396 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:58.756279 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730598.7558546, 1c4c59c3-660c-4f36-b589-af95eb8924f5 => ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:49:58.758105 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4c2be7a2-15f2-4121-bc11-50f890cd17e2 for instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:49:58.760562 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully detached device vdb from instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 from the live domain config.
May 14 03:49:58.762091 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:49:58.762281 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:58.762450 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:49:58.763315 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x79d090608320>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1c4c59c3-660c-4f36-b589-af95eb8924f5', 'attached_at': '', 'detached_at': '', 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'serial': '4c2be7a2-15f2-4121-bc11-50f890cd17e2'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:49:58.763438 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] closing encrypted volume /dev/dm-1 {{(pid=97948) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 14 03:49:58.793799 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:49:58.794130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:49:58.794346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:49:58.948889 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:59.647632 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.853s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:49:59.648947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c2be7a2-15f2-4121-bc11-50f890cd17e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:49:59.648947 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:49:59.677747 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2 (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:49:59.678715 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '186')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:49:59.678715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '182')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:59.681223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2', '181')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:49:59.681223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01c5580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:49:59.681223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Removing multipathed devices sdf, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:49:59.681223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Flush multipath device 330000000982887aa {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:49:59.718905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:59.725210 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:49:59.770325 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:49:59.835020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:49:59.835020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:49:59.835557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:49:59.846935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:49:59.846935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:49:59.861552 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.894063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.40.100,3260]
May 14 03:49:59.894063 np0000000741 nova-compute[97948]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.40.100,3260] successful.
May 14 03:49:59.894063 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.909085 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.919655 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.957921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.50.100,3260]
May 14 03:49:59.957921 np0000000741 nova-compute[97948]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-4c2be7a2-15f2-4121-bc11-50f890cd17e2, portal: 192.168.50.100,3260] successful.
May 14 03:49:59.957921 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.975346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:49:59.980341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:49:59.980341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] <== disconnect_volume: return (1183ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:49:59.980341 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:49:59.992736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:00.550327 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'flavor' on Instance uuid 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:01.552661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-180d97c4-93e6-4bf2-bfe1-96e9669d1120 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.916s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:01.990424 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:01.990632 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:01.990867 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:01.991026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:01.991157 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:01.993220 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Terminating instance
May 14 03:50:02.496577 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:50:02.514338 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.516458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.537374 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.541050 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.561256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.566010 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.671493 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:02.672757 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:02.674598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:02.674758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:02.675039 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] No waiting events found dispatching network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:02.675105 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61ad5753-6a5f-4306-9e69-60a68a63f7a6 req-55f1b81a-3017-4aa2-96b7-83461a513750 service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:50:02.730292 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:02.839653 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999773792999804 future=<Future at 0x79d0b0464ce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:02.841555 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Instance destroyed successfully.
May 14 03:50:02.841975 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lazy-loading 'resources' on Instance uuid 1c4c59c3-660c-4f36-b589-af95eb8924f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:03.345204 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-374823671',display_name='tempest-TestEncryptedCinderVolumes-server-374823671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-374823671',id=69,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKGIyOazPk+4IZsYmr0DF6GmnMDqlwZ3T7X66iy07q/iKoYq5FGOoyg6VaFswj4VfWzmY2CGql2KA1oKLe4StnJXlHiarqNx05RgzZ5AJdJeUNHMkzSMTdlB0+g48hDYQ==',key_name='tempest-keypair-1901818413',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:48:57Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43df7b9472f445dfbf816cb9b648332e',ramdisk_id='',reservation_id='r-3c8mh1jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-402629128',owner_user_name='tempest-TestEncryptedCinderVolumes-402629128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='547494feb9d9440690768b7350f15860',uuid=1c4c59c3-660c-4f36-b589-af95eb8924f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:50:03.345406 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converting VIF {"id": "4d05466d-efb8-4044-b7cc-82e97dad0137", "address": "fa:16:3e:a7:37:cc", "network": {"id": "79e469ec-e965-4a47-8f85-80f81ddd97ae", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1429420293-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "43df7b9472f445dfbf816cb9b648332e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05466d-ef", "ovs_interfaceid": "4d05466d-efb8-4044-b7cc-82e97dad0137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:03.345897 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:03.346170 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:50:03.346962 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:03.347126 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d05466d-ef, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:03.348250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:03.349386 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:03.349777 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:03.349890 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f89316fc-8f10-41d2-8b60-e06ddc888ae8) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:03.351179 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:03.356661 np0000000741 nova-compute[97948]: INFO os_vif [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=4d05466d-efb8-4044-b7cc-82e97dad0137,network=Network(79e469ec-e965-4a47-8f85-80f81ddd97ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05466d-ef')
May 14 03:50:03.356661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Deleting instance files /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5_del
May 14 03:50:03.356661 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Deletion of /opt/stack/data/nova/instances/1c4c59c3-660c-4f36-b589-af95eb8924f5_del complete
May 14 03:50:03.861405 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:50:03.861922 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:50:03.862022 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:50:03.862121 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:50:03.862728 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:03.950300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:03.988993 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:04.197540 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00033593900025152834 future=<Future at 0x79d090733f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:04.197674 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:04.197775 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.64159979399983 future=<Future at 0x79d0b0464ce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:04.197846 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=13.64152735100015 future=<Future at 0x79d0b0464ce0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:04.199238 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] Emitting event <LifecycleEvent: 1778730589.196932, 52a6c262-080c-4a62-a33f-672d7dc93631 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:04.199238 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] VM Stopped (Lifecycle Event)
May 14 03:50:04.456086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12d9e676-0695-4e13-825a-0bce596785b1 req-f776372d-b951-41c9-b48f-9baba21d073f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-deleted-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:04.456086 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-12d9e676-0695-4e13-825a-0bce596785b1 req-f776372d-b951-41c9-b48f-9baba21d073f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Neutron deleted interface 4d05466d-efb8-4044-b7cc-82e97dad0137; detaching it from the instance and deleting it from the info cache
May 14 03:50:04.456086 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-12d9e676-0695-4e13-825a-0bce596785b1 req-f776372d-b951-41c9-b48f-9baba21d073f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:04.702776 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-84101802-fcbd-4554-9763-5b83daa0bc1d tempest-TestMinimumBasicScenario-1441934481 tempest-TestMinimumBasicScenario-1441934481-project-member] [instance: 52a6c262-080c-4a62-a33f-672d7dc93631] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:04.739476 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:04.740040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] Acquiring lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:04.740231 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:04.740349 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:04.740497 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] No waiting events found dispatching network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:04.740733 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-23f04268-55a2-47a6-9315-855a6c8e51de req-2c9e3d31-9c33-4ac3-9439-e5a9a5e67e8f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Received event network-vif-unplugged-4d05466d-efb8-4044-b7cc-82e97dad0137 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:50:04.905529 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:04.959015 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-12d9e676-0695-4e13-825a-0bce596785b1 req-f776372d-b951-41c9-b48f-9baba21d073f service nova] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Detach interface failed, port_id=4d05466d-efb8-4044-b7cc-82e97dad0137, reason: Instance 1c4c59c3-660c-4f36-b589-af95eb8924f5 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:50:05.407675 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Took 1.55 seconds to deallocate network for instance.
May 14 03:50:05.914481 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:05.915003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:06.065094 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:06.065258 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:06.567678 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:07.074574 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.160s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:07.120372 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Deleted allocations for instance 1c4c59c3-660c-4f36-b589-af95eb8924f5
May 14 03:50:08.129763 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c064d1d8-ca2b-4a2b-9a38-2b3cc0f51607 tempest-TestEncryptedCinderVolumes-402629128 tempest-TestEncryptedCinderVolumes-402629128-project-member] Lock "1c4c59c3-660c-4f36-b589-af95eb8924f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.139s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:08.350566 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:08.599293 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:09.750674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:10.449628 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:11.515958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:11.516485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:11.728391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:12.020058 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:50:12.572813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:12.573130 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:12.576420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:50:12.576850 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Claim successful on node np0000000741
May 14 03:50:13.351937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:13.524286 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:13.786488 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:13.786903 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:13.955250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:14.289890 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:14.799120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.226s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:14.799580 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:50:15.305796 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:50:15.306688 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:50:15.307139 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:15.308183 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:15.394761 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ce7f78f81b4fe780ebc7a1d615a0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb53bd4f2841db99df994d7e6c2a72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:50:15.809084 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:50:15.896140 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Successfully created port: 5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:50:16.311864 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:50:16.385301 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Successfully updated port: 5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:50:16.433443 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received event network-changed-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:16.433570 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Refreshing instance network info cache due to event network-changed-5b2153eb-58dc-4ab9-8a13-db35c4cfc701. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:16.433732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] Acquiring lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:16.433824 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] Acquired lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:16.434307 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Refreshing network info cache for port 5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:16.815980 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Booting with volume 06c98c12-5547-43ab-a483-7ed8d262c41e at /dev/vda
May 14 03:50:16.864910 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:16.876600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:50:16.887223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:16.896699 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:16.937862 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:16.958080 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:50:16.958390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:50:16.968606 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:50:16.969694 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe87:a6ae', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe90:ce2d', 'fe80::d4d5:87ff:fe0d:5e75'] 
May 14 03:50:16.969919 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:50:16.970007 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:50:16.970322 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:16.970624 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating existing volume attachment record: 36bf87eb-1c0c-4964-b412-a19f7a817af4 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:50:17.019471 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:50:17.184986 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:17.687059 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fe7398a8-4877-4083-b3d7-164be3f9c62b req-000a8663-211f-4919-935d-7f26da8bddcf service nova] Releasing lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:17.687861 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquired lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:17.688023 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:50:17.787396 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:17.839933 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004954080000061367 future=<Future at 0x79d0b0464ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:17.840480 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:17.842470 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730602.8393328, 1c4c59c3-660c-4f36-b589-af95eb8924f5 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:17.842470 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] VM Stopped (Lifecycle Event)
May 14 03:50:18.302917 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:50:18.344008 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b9b266fe-1c60-405f-8d80-f9fc0e98d9b0 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 1c4c59c3-660c-4f36-b589-af95eb8924f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:18.355271 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:18.477899 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:18.630370 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating instance_info_cache with network_info: [{"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:18.957905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:19.062486 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:50:19.063590 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:50:19.063837 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Creating image(s)
May 14 03:50:19.064158 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:50:19.064274 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Ensure instance console log exists: /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:50:19.064516 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:19.064706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:19.064831 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:19.131981 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Releasing lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:19.131981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance network_info: |[{"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:50:19.133030 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Start _get_guest_xml network_info=[{"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49c8d02e-6d1d-4af3-bd13-4c63765c5c04', 'attached_at': '', 'detached_at': '', 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'serial': '06c98c12-5547-43ab-a483-7ed8d262c41e'}, 'boot_index': 0, 'attachment_id': '36bf87eb-1c0c-4964-b412-a19f7a817af4', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:50:19.136948 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:50:19.138456 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1162676206', uuid='49c8d02e-6d1d-4af3-bd13-4c63765c5c04'), owner=OwnerMeta(userid='05ce7f78f81b4fe780ebc7a1d615a0ec', username='tempest-TestEncryptedCinderVolumes-2068807358-project-member', projectid='71fb53bd4f2841db99df994d7e6c2a72', projectname='tempest-TestEncryptedCinderVolumes-2068807358'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730619.137999) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:50:19.139605 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:50:19.140022 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:50:19.141052 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:50:19.141268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:50:19.142605 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:50:19.142994 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:50:19.143204 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:50:19.143356 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:50:19.143545 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:50:19.143703 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:50:19.143850 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:50:19.144143 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:50:19.144300 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:50:19.144512 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:50:19.144656 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:50:19.144847 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:50:19.161575 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:50:19.161969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:19.162489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:19.316916 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:21.517202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.355s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:21.517626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:50:21.528677 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:21.529276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:21.530260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:21.530443 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:21.530728 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:21.530861 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:21.542083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:21.542083 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:21.543747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:21.543747 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:21.554732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e] added
May 14 03:50:21.554732 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:21.554732 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:21.554732 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:21.554732 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:21.554732 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:21.554732 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:21.554921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:21.555036 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:21.555197 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:21.558618 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e] added
May 14 03:50:21.558618 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:21.558618 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:21.558618 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:21.558618 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:21.558618 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:21.558618 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:21.558938 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:21.558938 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:21.558990 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:22.080614 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:22.555619 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:22.559856 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:22.568324 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:22.568324 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:22.579020 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:22.579020 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.584193 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.592956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.599204 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.599204 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.599204 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.599204 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.599204 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:22.599584 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.599584 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.599584 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.599584 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.599584 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.609754 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:22.631611 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.40.100,3260]
May 14 03:50:22.631611 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.40.100,3260] successful.
May 14 03:50:22.631611 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.651602 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.662477 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.50.100,3260]
May 14 03:50:22.662477 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.50.100,3260] successful.
May 14 03:50:22.662477 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.672754 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.672913 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:22.673297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:22.673297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:22.674091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('11', '-', '-', 0) found on session 191 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:22.674215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:22.675070 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:22.693307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 191 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:22.693307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.698980 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a58e1f-3233-4ce6-b5b1-59942a144fcc (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:22.699216 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:22.699451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:22.699529 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:22.703259 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] HCTL ('12', '-', '-', 0) found on session 192 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:22.703414 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:22.720790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Searching for a device in session 192 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:22.720937 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:23.356229 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:23.532226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:50:23.799974 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:23.800507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:23.886069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:23.886433 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:23.959440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:24.303711 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lazy-loading 'flavor' on Instance uuid 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:24.388452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:50:24.552270 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Found WWN 330000000566c5ff3 for multipath device dm-4 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:50:24.552581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:24.553629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== connect_volume: return (5391ms) {'type': 'block', 'scsi_wwn': '330000000566c5ff3', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000566c5ff3'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:24.553845 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000566c5ff3', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000566c5ff3'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:50:24.571766 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:24.588292 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '49c8d02e-6d1d-4af3-bd13-4c63765c5c04', 'attached_at': '', 'detached_at': '', 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'serial': '06c98c12-5547-43ab-a483-7ed8d262c41e'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:50:24.588745 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:50:24.588904 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:50:24.589090 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:50:24.603016 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:50:24.603016 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:50:24.603016 np0000000741 nova-compute[97948]:     <volume>06c98c12-5547-43ab-a483-7ed8d262c41e</volume>
May 14 03:50:24.603016 np0000000741 nova-compute[97948]:   </usage>
May 14 03:50:24.603016 np0000000741 nova-compute[97948]: </secret>
May 14 03:50:24.603016 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:50:24.939843 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:24.940161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:24.944308 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:50:24.944605 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Claim successful on node np0000000741
May 14 03:50:25.110904 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1162676206',display_name='tempest-TestEncryptedCinderVolumes-server-1162676206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1162676206',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-f7op1itg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:16Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=49c8d02e-6d1d-4af3-bd13-4c63765c5c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:50:25.111099 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:25.111588 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:25.112525 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:25.308216 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:25.615072 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] End _get_guest_xml xml=<domain type="qemu">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <uuid>49c8d02e-6d1d-4af3-bd13-4c63765c5c04</uuid>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <name>instance-00000049</name>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1162676206</nova:name>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:50:19</nova:creationTime>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:user uuid="05ce7f78f81b4fe780ebc7a1d615a0ec">tempest-TestEncryptedCinderVolumes-2068807358-project-member</nova:user>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:project uuid="71fb53bd4f2841db99df994d7e6c2a72">tempest-TestEncryptedCinderVolumes-2068807358</nova:project>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <nova:port uuid="5b2153eb-58dc-4ab9-8a13-db35c4cfc701">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <system>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="serial">49c8d02e-6d1d-4af3-bd13-4c63765c5c04</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="uuid">49c8d02e-6d1d-4af3-bd13-4c63765c5c04</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </system>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <os>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </os>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <features>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </features>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   <devices>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/disk.config"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <alias name="ua-06c98c12-5547-43ab-a483-7ed8d262c41e"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <serial>06c98c12-5547-43ab-a483-7ed8d262c41e</serial>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <encryption format="luks">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:         <secret type="passphrase" uuid="04c698d5-4977-4032-9a4c-7e24ddeeef6c"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       </encryption>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:34:a1:25"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <target dev="tap5b2153eb-58"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </interface>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/console.log" append="off"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </serial>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <video>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </video>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </rng>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:   </devices>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]: </domain>
May 14 03:50:25.615072 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Preparing to wait for external event network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1162676206',display_name='tempest-TestEncryptedCinderVolumes-server-1162676206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1162676206',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-f7op1itg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:16Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=49c8d02e-6d1d-4af3-bd13-4c63765c5c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:25.617020 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:25.617472 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:50:25.617628 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:25.617824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:25.618019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:50:25.618946 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:25.619203 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c549ef9-41a7-5a33-9949-9371c62455d5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:25.621794 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:25.623414 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:25.623561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2153eb-58, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:25.623876 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2153eb-58, col_values=(('qos', UUID('9ff3ed9b-87bd-4041-aa1b-7c1520dd4db0')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:25.624046 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2153eb-58, col_values=(('external_ids', {'iface-id': '5b2153eb-58dc-4ab9-8a13-db35c4cfc701', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:a1:25', 'vm-uuid': '49c8d02e-6d1d-4af3-bd13-4c63765c5c04'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:25.624736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:25.625732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:25.630781 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:25.631542 np0000000741 nova-compute[97948]: INFO os_vif [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58')
May 14 03:50:26.169910 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:26.170259 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:26.456732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:26.456886 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:26.457053 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Attaching volume fe0bb6b0-ab18-4aae-9b5a-4a923ece995f to /dev/vdb
May 14 03:50:26.494455 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:26.506614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:50:26.528026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:26.581000 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:50:26.581521 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:50:26.592215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:50:26.593186 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe87:a6ae', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe90:ce2d', 'fe80::d4d5:87ff:fe0d:5e75'] 
May 14 03:50:26.593329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:50:26.593442 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:50:26.593722 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:26.594380 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating existing volume attachment record: 7a5699cc-c16d-4001-acfd-f7527ecac68f {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:50:26.673615 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:26.784014 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:26.785054 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:27.144737 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:50:27.145200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:27.145439 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:27.145994 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:27.146214 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:50:27.150750 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:27.150891 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:27.151047 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] No VIF found with MAC fa:16:3e:34:a1:25, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:50:27.151593 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Using config drive
May 14 03:50:27.158028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:27.158512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:27.159112 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:27.159351 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:27.159936 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:27.160040 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:27.170174 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:27.170174 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:27.174498 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:27.174498 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:27.181573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.241s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:27.181914 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:50:27.184734 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f] added
May 14 03:50:27.184734 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:27.184734 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:27.184734 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:27.184734 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:27.184734 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:27.184734 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:27.185037 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:27.185308 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:27.185533 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:27.186002 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f] added
May 14 03:50:27.186002 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:27.186002 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:27.186002 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:27.186002 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:27.186002 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:27.186002 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:27.186159 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:27.186335 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:27.186475 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:27.658476 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:27.690962 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:50:27.691269 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:50:27.691590 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:27.692459 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:27.778085 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:27.778432 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:27.789819 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Creating config drive at /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/disk.config
May 14 03:50:27.791402 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8406aaa75274bfa842bca7d95576f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55f169d311447d9a628b9ab9e7f4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:50:27.796144 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg9rk4ogp {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:27.855494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg9rk4ogp" returned: 0 in 0.059s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:28.186077 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:28.186967 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:28.194761 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:28.200515 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:28.200515 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:28.208018 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:28.208018 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.214920 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.222864 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.230176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.230176 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.230176 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.230176 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.230176 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:28.230420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.230420 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.230420 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.230420 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.230420 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:28.238032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.238032 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.238032 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.238032 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.238032 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:28.238627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.238627 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.238627 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.238627 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.238627 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:28.275461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.50.100,3260]
May 14 03:50:28.275461 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.50.100,3260] successful.
May 14 03:50:28.275461 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.276499 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.40.100,3260]
May 14 03:50:28.276499 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.40.100,3260] successful.
May 14 03:50:28.276499 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.290327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.295800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.304482 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.304837 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:28.305022 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:28.305144 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:28.305982 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] HCTL ('10', '-', '-', 0) found on session 194 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:28.306127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:28.306695 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.311975 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:28.312309 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:28.312309 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:28.312603 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:28.313177 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] HCTL ('9', '-', '-', 0) found on session 193 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:28.313310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:28.332865 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.336624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Searching for a device in session 194 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:28.336624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:28.344334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Searching for a device in session 193 and hctl ['9', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:28.344334 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:28.388536 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Successfully created port: 6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:50:28.429763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.515293 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3a2f682a-4199-4c19-8f9a-6f442b311324 req-88216a5c-34cd-42ad-9964-85ef306e515c service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received event network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:28.515604 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3a2f682a-4199-4c19-8f9a-6f442b311324 req-88216a5c-34cd-42ad-9964-85ef306e515c service nova] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:28.516104 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3a2f682a-4199-4c19-8f9a-6f442b311324 req-88216a5c-34cd-42ad-9964-85ef306e515c service nova] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:28.516192 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3a2f682a-4199-4c19-8f9a-6f442b311324 req-88216a5c-34cd-42ad-9964-85ef306e515c service nova] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:28.516290 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3a2f682a-4199-4c19-8f9a-6f442b311324 req-88216a5c-34cd-42ad-9964-85ef306e515c service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Processing event network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:50:28.576299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:28.576496 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:28.658429 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.660743 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.664611 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.685555 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.689631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:28.698648 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:50:28.783187 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:28.783619 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:28.783782 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 03:50:28.960720 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:29.005519 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Successfully updated port: 6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:50:29.080850 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:50:29.160343 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:50:29.203204 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Booting with volume 201eb018-8e5c-4198-99f4-472e88c7c417 at /dev/vda
May 14 03:50:29.253879 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:29.265020 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:50:29.286873 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] There are 0 instances to clean {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 03:50:29.287233 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:29.289198 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:29.346580 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:50:29.346838 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:50:29.359080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:50:29.360131 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe87:a6ae', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe90:ce2d', 'fe80::d4d5:87ff:fe0d:5e75', 'fe80::fc16:3eff:fe34:a125', 'fe80::34ec:6bff:feb3:d1f'] 
May 14 03:50:29.360313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:50:29.360437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:50:29.360718 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:29.360969 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating existing volume attachment record: 661ffef8-d09b-4933-a7ff-20c16a6ad758 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:50:29.507838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:29.508092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquired lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:29.508281 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:50:29.630100 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:29.630381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:29.635325 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:50:29.635477 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Claim successful on node np0000000741
May 14 03:50:29.790083 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:30.051497 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:50:30.052040 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730630.051689, 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:30.052323 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] VM Started (Lifecycle Event)
May 14 03:50:30.053751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:50:30.056336 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance spawned successfully.
May 14 03:50:30.056682 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:50:30.068822 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:50:30.181721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Found WWN 330000000faed4554 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:50:30.181721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:30.181721 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000faed4554', 'path': '/dev/dm-1', 'multipath_id': '330000000faed4554'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:30.181721 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000faed4554', 'path': '/dev/dm-1', 'multipath_id': '330000000faed4554'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:50:30.184837 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lazy-loading 'flavor' on Instance uuid 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:30.229770 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:30.353309 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:30.555707 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:30.558075 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:30.566080 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.566335 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.566613 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.566939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.569058 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.569723 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:30.593448 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received event network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:30.594183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:30.594573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:30.594573 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:30.594747 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] No waiting events found dispatching network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:30.594910 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received unexpected event network-vif-plugged-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 for instance with vm_state building and task_state spawning.
May 14 03:50:30.595055 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:30.595251 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing instance network info cache due to event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:30.595420 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Acquiring lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:30.624919 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:30.689660 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Attempting to attach volume fe0bb6b0-ab18-4aae-9b5a-4a923ece995f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:50:30.690568 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:   <alias name="ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f"/>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:   <serial>fe0bb6b0-ab18-4aae-9b5a-4a923ece995f</serial>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]: </disk>
May 14 03:50:30.690568 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:50:30.857056 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Releasing lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:30.857387 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Instance network_info: |[{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:50:30.858103 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Acquired lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:30.858345 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:30.912516 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:30.913861 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:31.063760 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:50:31.065534 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730631.0640016, 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:31.065534 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] VM Paused (Lifecycle Event)
May 14 03:50:31.074295 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Took 12.01 seconds to spawn the instance on the hypervisor.
May 14 03:50:31.074479 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:31.360730 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:31.417435 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:31.480314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:50:31.481411 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:50:31.481595 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Creating image(s)
May 14 03:50:31.481915 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:50:31.482036 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Ensure instance console log exists: /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:50:31.482225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:31.482361 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:31.482518 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:31.482943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Start _get_guest_xml network_info=[{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'eac6d4d5-5e59-4f66-bdca-1edd074e3425', 'attached_at': '', 'detached_at': '', 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'serial': '201eb018-8e5c-4198-99f4-472e88c7c417'}, 'boot_index': 0, 'attachment_id': '661ffef8-d09b-4933-a7ff-20c16a6ad758', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:50:31.485101 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:50:31.486337 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1914793910', uuid='eac6d4d5-5e59-4f66-bdca-1edd074e3425'), owner=OwnerMeta(userid='d8406aaa75274bfa842bca7d95576f02', username='tempest-TestVolumeBootPattern-1781728370-project-member', projectid='2f55f169d311447d9a628b9ab9e7f4a6', projectname='tempest-TestVolumeBootPattern-1781728370'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730631.4860673) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:50:31.490813 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:50:31.491087 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:50:31.492061 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:50:31.492400 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:50:31.493362 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:50:31.493708 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:50:31.493819 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:50:31.493870 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:50:31.493972 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:50:31.494045 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:50:31.494129 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:50:31.494388 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:50:31.494513 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:50:31.494574 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:50:31.494675 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:50:31.494792 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:50:31.505858 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:50:31.506154 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:31.506281 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:31.506553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:31.507224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:50:31.520404 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:31.520954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:31.521456 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:31.521613 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:31.524660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:31.524660 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:31.533164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:31.533164 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:31.538345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:31.538345 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:31.546226 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417] added
May 14 03:50:31.546226 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:31.546226 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:31.546226 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:31.546226 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:31.546226 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:31.546226 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:31.546492 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:31.546631 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:31.546792 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:31.550587 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417] added
May 14 03:50:31.550587 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:31.550587 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:31.550587 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:31.550587 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:31.550587 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:31.550587 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:31.550834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:31.550940 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:31.551086 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:31.566797 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:31.569746 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730631.5695357, 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:31.569944 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] VM Resumed (Lifecycle Event)
May 14 03:50:31.583859 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Took 19.06 seconds to build instance.
May 14 03:50:31.669330 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:31.787782 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updated VIF entry in instance network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:50:31.788000 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:31.789800 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:31.789800 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:31.924967 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.293s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:31.924967 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:50:32.072129 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:32.074126 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:32.085436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-37e2b47e-65ac-4d9d-8ef9-fd436dce27be tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.569s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:32.289595 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8eaba006-a038-428f-acc3-7b5e606cecca req-fb6dc776-7109-44d5-8d81-b27479a92f47 service nova] Releasing lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:32.352567 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:32.354656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:32.354656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:32.354656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] No VIF found with MAC fa:16:3e:90:ce:2d, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:50:32.429679 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:50:32.429992 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:50:32.430476 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:32.430476 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:32.504773 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1502fd1ebb564a38a0329ad56584a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963dbf38a7f450c88af23dc0786e125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:50:32.547283 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:32.551538 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:32.563859 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:32.563859 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:32.570055 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:32.570055 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.576581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.583762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.592201 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.592426 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.599520 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.599701 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:32.637893 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.40.100,3260]
May 14 03:50:32.637893 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.40.100,3260] successful.
May 14 03:50:32.637893 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.649762 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.657265 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.50.100,3260]
May 14 03:50:32.657265 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.50.100,3260] successful.
May 14 03:50:32.657265 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.665585 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.665942 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:32.665942 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:32.666255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:32.666855 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('13', '-', '-', 0) found on session 195 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:32.666964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:32.674971 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:32.692623 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 195 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:32.692623 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.696969 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:32.697283 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:32.697535 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:32.697619 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:32.698563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] HCTL ('14', '-', '-', 0) found on session 196 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:32.698720 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:32.718723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Searching for a device in session 196 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:32.718833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:32.784963 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:32.784963 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:50:32.784963 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:32.933436 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:50:33.012037 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Successfully created port: 400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:50:33.293422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:33.293550 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:33.293671 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:33.293795 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:50:33.436501 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:50:33.522341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:50:33.558525 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Successfully updated port: 400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:50:33.634799 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-changed-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:33.635778 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Refreshing instance network info cache due to event network-changed-400adc7c-85ac-46d1-b0ef-9fac13a3f90f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:33.635778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] Acquiring lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:33.635778 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] Acquired lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:33.635778 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Refreshing network info cache for port 400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:33.663385 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received event network-changed-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:33.670023 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Refreshing instance network info cache due to event network-changed-5b2153eb-58dc-4ab9-8a13-db35c4cfc701. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:33.670357 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] Acquiring lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:33.670505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] Acquired lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:33.670820 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Refreshing network info cache for port 5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:33.916660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1bd068a2-74bc-48da-9293-3d3fc57f8f32 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.460s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:33.940919 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Booting with volume 72b3e82b-127c-4af5-8457-3070ef0ed0d2 at /dev/vda
May 14 03:50:33.962150 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:33.981312 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:33.992292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:50:34.022411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:34.063381 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:34.079726 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:50:34.079970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:50:34.089275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:50:34.090275 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe87:a6ae', 'fe80::14cb:8fff:fe43:ccbf', 'fe80::fc16:3eff:fe90:ce2d', 'fe80::d4d5:87ff:fe0d:5e75', 'fe80::fc16:3eff:fe34:a125', 'fe80::34ec:6bff:feb3:d1f'] 
May 14 03:50:34.090387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:50:34.090485 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:50:34.090751 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:34.090954 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updating existing volume attachment record: 4f2786b9-48b0-4d4b-b459-4a36228bec3c {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:50:34.139338 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:34.172953 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:34.215229 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:50:34.323420 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:50:34.331777 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:34.372459 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:34.436010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:34.437887 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:34.525712 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:34.526044 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:50:34.530131 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:50:34.532290 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:50:34.533240 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:34.554284 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:34.558802 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Found WWN 330000000ab95b618 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:50:34.560069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:34.560108 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '330000000ab95b618', 'path': '/dev/dm-5', 'multipath_id': '330000000ab95b618'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:34.560303 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ab95b618', 'path': '/dev/dm-5', 'multipath_id': '330000000ab95b618'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:50:34.581449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:34.581841 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13311MB free_disk=72.71505355834961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:50:34.582077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:34.582362 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:34.700586 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updated VIF entry in instance network info cache for port 5b2153eb-58dc-4ab9-8a13-db35c4cfc701. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:50:34.701024 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating instance_info_cache with network_info: [{"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:34.875986 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-13535208-f9b5-4378-a6b3-b536b2347233 req-4aa08fa4-8e43-4778-ae8d-f57bf6dbfc0d service nova] Releasing lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:34.876598 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquired lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:34.876921 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:50:34.907468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:34.907468 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:35.077412 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914793910',display_name='tempest-TestVolumeBootPattern-server-1914793910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1914793910',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-yomp0wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:29Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=eac6d4d5-5e59-4f66-bdca-1edd074e3425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:50:35.077794 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:35.078470 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:35.079159 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'pci_devices' on Instance uuid eac6d4d5-5e59-4f66-bdca-1edd074e3425 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:35.203015 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3874efd2-edb3-4ac7-84de-b65f191ca2e8 req-e5260d25-774c-485c-acdc-1f50d027f95a service nova] Releasing lock "refresh_cache-49c8d02e-6d1d-4af3-bd13-4c63765c5c04" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:35.410018 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Detaching volume fe0bb6b0-ab18-4aae-9b5a-4a923ece995f
May 14 03:50:35.445712 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Attempting to driver detach volume fe0bb6b0-ab18-4aae-9b5a-4a923ece995f from mountpoint /dev/vdb
May 14 03:50:35.456596 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Found disk vdb by alias ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:50:35.458046 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Found disk vdb by alias ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:50:35.458776 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Attempting to detach device vdb from instance 076da36f-3685-4e03-b748-e158fb0c9c00 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:50:35.460344 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <alias name="ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f"/>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <serial>fe0bb6b0-ab18-4aae-9b5a-4a923ece995f</serial>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]: </disk>
May 14 03:50:35.460344 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:50:35.462221 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:50:35.469484 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Successfully detached device vdb from instance 076da36f-3685-4e03-b748-e158fb0c9c00 from the persistent domain config.
May 14 03:50:35.469484 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] (1/8): Attempting to detach device vdb with device alias ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f from instance 076da36f-3685-4e03-b748-e158fb0c9c00 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:50:35.469484 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <alias name="ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f"/>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-1"/>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <serial>fe0bb6b0-ab18-4aae-9b5a-4a923ece995f</serial>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]: </disk>
May 14 03:50:35.469484 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:50:35.581816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] End _get_guest_xml xml=<domain type="qemu">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <uuid>eac6d4d5-5e59-4f66-bdca-1edd074e3425</uuid>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <name>instance-0000004a</name>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPattern-server-1914793910</nova:name>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:50:31</nova:creationTime>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:user uuid="d8406aaa75274bfa842bca7d95576f02">tempest-TestVolumeBootPattern-1781728370-project-member</nova:user>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:project uuid="2f55f169d311447d9a628b9ab9e7f4a6">tempest-TestVolumeBootPattern-1781728370</nova:project>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         <nova:port uuid="6840ddab-3472-4eb0-99b3-2574a3218221">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <system>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="serial">eac6d4d5-5e59-4f66-bdca-1edd074e3425</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="uuid">eac6d4d5-5e59-4f66-bdca-1edd074e3425</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </system>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <os>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </os>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <features>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </features>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   <devices>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/disk.config"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <alias name="ua-201eb018-8e5c-4198-99f4-472e88c7c417"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-5"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <serial>201eb018-8e5c-4198-99f4-472e88c7c417</serial>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0a:1e:68"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <target dev="tap6840ddab-34"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </interface>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/console.log" append="off"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </serial>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <video>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </video>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </rng>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:   </devices>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]: </domain>
May 14 03:50:35.581816 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Preparing to wait for external event network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914793910',display_name='tempest-TestVolumeBootPattern-server-1914793910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1914793910',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-yomp0wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:29Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=eac6d4d5-5e59-4f66-bdca-1edd074e3425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:35.587736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47548fd7-27d4-58c9-9ea1-ff587db61f12', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:35.593284 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:35.594736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:35.599291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:35.599462 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6840ddab-34, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:35.599815 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6840ddab-34, col_values=(('qos', UUID('ce309527-e950-4472-aac8-e266501d8e9e')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:35.599989 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6840ddab-34, col_values=(('external_ids', {'iface-id': '6840ddab-3472-4eb0-99b3-2574a3218221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:1e:68', 'vm-uuid': 'eac6d4d5-5e59-4f66-bdca-1edd074e3425'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:35.601983 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:35.612657 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:35.612657 np0000000741 nova-compute[97948]: INFO os_vif [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34')
May 14 03:50:35.642657 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:35.668984 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 6b67511f-42d0-418f-8315-3072389f618b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:50:35.669192 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 076da36f-3685-4e03-b748-e158fb0c9c00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:50:35.671654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:50:35.671654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance eac6d4d5-5e59-4f66-bdca-1edd074e3425 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:50:35.671654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:50:35.671654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:50:35.671654 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:50:34 up 42 min,  2 users,  load average: 5.33, 5.86, 4.91\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_2f55f169d311447d9a628b9ab9e7f4a6': '2', 'io_workload': '2', 'num_proj_5d6f0014a3d247b496b2a4a9181936b0': '1', 'num_proj_71fb53bd4f2841db99df994d7e6c2a72': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_task_block_device_mapping': '1', 'num_proj_d963dbf38a7f450c88af23dc0786e125': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:50:35.785803 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updating instance_info_cache with network_info: [{"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:36.007041 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:36.007277 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:36.042681 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730636.042265, 076da36f-3685-4e03-b748-e158fb0c9c00 => ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:50:36.044990 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f for instance 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:50:36.048418 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Successfully detached device vdb from instance 076da36f-3685-4e03-b748-e158fb0c9c00 from the live domain config.
May 14 03:50:36.051466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:50:36.051789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:36.051902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:36.052258 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:36.052527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:50:36.052665 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:36.085516 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:36.085902 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:36.085902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '196')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:50:36.086211 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', '193')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:50:36.087371 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f', '194')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:50:36.088384 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81ee520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:50:36.088614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:50:36.088902 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Flush multipath device 330000000faed4554 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:50:36.124421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:50:36.171331 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:50:36.190252 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:50:36.191409 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:50:36.191674 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Creating image(s)
May 14 03:50:36.191997 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:50:36.192143 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Ensure instance console log exists: /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:50:36.192372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:36.192539 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:36.192694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:36.222156 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:50:36.222322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:50:36.223501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:50:36.236714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:50:36.236911 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:50:36.249003 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.275519 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.40.100,3260]
May 14 03:50:36.275519 np0000000741 nova-compute[97948]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.40.100,3260] successful.
May 14 03:50:36.275519 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.291195 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.292032 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Releasing lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:36.292032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance network_info: |[{"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:50:36.292737 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Start _get_guest_xml network_info=[{"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b', 'attached_at': '', 'detached_at': '', 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'serial': '72b3e82b-127c-4af5-8457-3070ef0ed0d2'}, 'boot_index': 0, 'attachment_id': '4f2786b9-48b0-4d4b-b459-4a36228bec3c', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:50:36.294972 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:50:36.295930 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1516623699', uuid='3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b'), owner=OwnerMeta(userid='1502fd1ebb564a38a0329ad56584a769', username='tempest-TestVolumeBootPatternV346-1499777380-project-member', projectid='d963dbf38a7f450c88af23dc0786e125', projectname='tempest-TestVolumeBootPatternV346-1499777380'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730636.2956035) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:50:36.296970 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:50:36.297256 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:50:36.298154 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:50:36.298286 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:50:36.299033 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:50:36.299288 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:50:36.299423 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:50:36.299504 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:50:36.299629 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:50:36.299746 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:50:36.299851 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:50:36.299989 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:50:36.300077 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:50:36.300185 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:50:36.300277 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:50:36.300377 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:50:36.307526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.310679 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:50:36.310980 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:50:36.311145 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:36.339514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.50.100,3260]
May 14 03:50:36.339514 np0000000741 nova-compute[97948]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-fe0bb6b0-ab18-4aae-9b5a-4a923ece995f, portal: 192.168.50.100,3260] successful.
May 14 03:50:36.339514 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.353289 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.353655 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:36.353906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] <== disconnect_volume: return (302ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:36.354118 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:50:36.354354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.043s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:36.354569 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:50:36.365352 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:36.365851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:50:36.366203 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:36.366384 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:36.366953 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:50:36.366953 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:36.381317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:36.381317 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.386408 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:50:36.386408 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.394922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2] added
May 14 03:50:36.394922 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:36.394922 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:36.394922 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:36.394922 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:36.394922 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:36.394922 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.395176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:36.395245 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:36.395426 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2] added
May 14 03:50:36.401794 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:50:36.401794 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:50:36.401794 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:50:36.510146 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:36.911674 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lazy-loading 'flavor' on Instance uuid 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:37.017103 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:50:37.017315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.435s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:37.017778 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:37.129626 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:37.129765 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:37.129834 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] No VIF found with MAC fa:16:3e:0a:1e:68, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:50:37.130222 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Using config drive
May 14 03:50:37.395852 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:50:37.402044 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:37.409455 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:37.409455 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:50:37.417200 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:50:37.417200 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.426665 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.431891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.444593 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.444835 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.450326 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:37.484661 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.40.100,3260]
May 14 03:50:37.484661 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.40.100,3260] successful.
May 14 03:50:37.484661 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.491803 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.50.100,3260]
May 14 03:50:37.491803 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.50.100,3260] successful.
May 14 03:50:37.491803 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.501074 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.505946 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.516282 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.516833 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:37.516833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:37.517581 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('9', '-', '-', 0) found on session 197 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:37.517708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:50:37.527292 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('10', '-', '-', 0) found on session 198 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:50:37.527292 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:50:37.536071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 197 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:37.536164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:37.543601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 198 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:50:37.543601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:50:37.644928 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:37.802330 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Creating config drive at /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/disk.config
May 14 03:50:37.806460 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmm22oqot {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:37.859723 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmm22oqot" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:37.918485 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-acac91f7-61a3-4dc7-bdf2-69dad63eb5e9 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.011s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:38.016850 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:38.017633 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:38.017995 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:38.018364 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.76 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:38.269111 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.298124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.303919 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.367346 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:50:38.386895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.410026 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.410941 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:38.441295 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0e07b2c7-8d73-4f0c-8554-a0c18a6306c8 req-abbb4257-13a5-4fd4-86ac-5c1e8f988fec service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:38.441648 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0e07b2c7-8d73-4f0c-8554-a0c18a6306c8 req-abbb4257-13a5-4fd4-86ac-5c1e8f988fec service nova] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:38.441849 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0e07b2c7-8d73-4f0c-8554-a0c18a6306c8 req-abbb4257-13a5-4fd4-86ac-5c1e8f988fec service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:38.442014 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0e07b2c7-8d73-4f0c-8554-a0c18a6306c8 req-abbb4257-13a5-4fd4-86ac-5c1e8f988fec service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:38.442193 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0e07b2c7-8d73-4f0c-8554-a0c18a6306c8 req-abbb4257-13a5-4fd4-86ac-5c1e8f988fec service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Processing event network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:50:38.513150 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:38.963859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:39.049031 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730639.048555, eac6d4d5-5e59-4f66-bdca-1edd074e3425 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:39.049419 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:50:39.049586 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] VM Started (Lifecycle Event)
May 14 03:50:39.051469 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:50:39.053737 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Instance spawned successfully.
May 14 03:50:39.053987 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:50:39.343532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:39.343678 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:39.343881 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:39.344033 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:39.344170 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:39.346738 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Terminating instance
May 14 03:50:39.382673 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Found WWN 3300000005e57ccf7 for multipath device dm-1 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:50:39.383032 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:50:39.383212 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== connect_volume: return (3072ms) {'type': 'block', 'scsi_wwn': '3300000005e57ccf7', 'path': '/dev/dm-1', 'multipath_id': '3300000005e57ccf7'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:50:39.383343 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005e57ccf7', 'path': '/dev/dm-1', 'multipath_id': '3300000005e57ccf7'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:50:39.553154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:39.557110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:39.561889 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.562003 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.562305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.562533 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.562809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.563010 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:39.850453 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:50:39.879913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:39.882688 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:39.892095 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1516623699',display_name='tempest-TestVolumeBootPatternV346-server-1516623699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1516623699',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWG2gdDE0/f9vFAT7stLcCRSAvDr0nqf+NxcgPx2mXc7/b+smFKk41M7QiFumtNjm08ovsMV7TZmWDgfr2ANCR3WNLQJeWrYiN4bey6UOdXKLncfc0faTyNjBJ523neww==',key_name='tempest-keypair-508110720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-gol3k806',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:50:39.892366 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:39.893371 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:39.895892 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:39.902750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:39.929436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:39.930430 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.051648 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:40.052020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:40.052020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:40.052020 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:40.052237 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] No waiting events found dispatching network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:40.052275 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-bbfbfaeb-83e8-40b5-8360-177df962a049 req-e1273575-ed0d-4e04-ba40-779bf3de6e33 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:50:40.061271 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:50:40.061271 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730640.0609646, eac6d4d5-5e59-4f66-bdca-1edd074e3425 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:40.061271 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] VM Paused (Lifecycle Event)
May 14 03:50:40.073051 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Took 8.59 seconds to spawn the instance on the hypervisor.
May 14 03:50:40.073238 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:40.158027 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.165915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.187182 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Instance destroyed successfully.
May 14 03:50:40.187688 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lazy-loading 'resources' on Instance uuid 076da36f-3685-4e03-b748-e158fb0c9c00 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:50:40.397899 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] End _get_guest_xml xml=<domain type="qemu">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <uuid>3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b</uuid>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <name>instance-0000004b</name>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1516623699</nova:name>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:50:36</nova:creationTime>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:user uuid="1502fd1ebb564a38a0329ad56584a769">tempest-TestVolumeBootPatternV346-1499777380-project-member</nova:user>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:project uuid="d963dbf38a7f450c88af23dc0786e125">tempest-TestVolumeBootPatternV346-1499777380</nova:project>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         <nova:port uuid="400adc7c-85ac-46d1-b0ef-9fac13a3f90f">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <system>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="serial">3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="uuid">3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </system>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <os>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </os>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <features>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </features>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   <devices>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/disk.config"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <alias name="ua-72b3e82b-127c-4af5-8457-3070ef0ed0d2"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-1"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <serial>72b3e82b-127c-4af5-8457-3070ef0ed0d2</serial>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </disk>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:5f:c2:6b"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <target dev="tap400adc7c-85"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </interface>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/console.log" append="off"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </serial>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <video>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </video>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </rng>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:   </devices>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]: </domain>
May 14 03:50:40.397899 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Preparing to wait for external event network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1516623699',display_name='tempest-TestVolumeBootPatternV346-server-1516623699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1516623699',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWG2gdDE0/f9vFAT7stLcCRSAvDr0nqf+NxcgPx2mXc7/b+smFKk41M7QiFumtNjm08ovsMV7TZmWDgfr2ANCR3WNLQJeWrYiN4bey6UOdXKLncfc0faTyNjBJ523neww==',key_name='tempest-keypair-508110720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-gol3k806',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.400834 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:50:40.401382 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.401485 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad4b5316-7ef3-5880-86dc-0c72fcd07b05', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.402624 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.403406 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:40.408422 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.410401 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.410580 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap400adc7c-85, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.410949 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap400adc7c-85, col_values=(('qos', UUID('01747622-71cd-49cf-a9cd-9db0ac7c56a9')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.411139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap400adc7c-85, col_values=(('external_ids', {'iface-id': '400adc7c-85ac-46d1-b0ef-9fac13a3f90f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:c2:6b', 'vm-uuid': '3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.412230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.413584 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:40.421448 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.422617 np0000000741 nova-compute[97948]: INFO os_vif [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85')
May 14 03:50:40.495923 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:40.496327 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:40.496477 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:40.496578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:40.496707 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] No waiting events found dispatching network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:40.496829 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-ddcd1a93-b313-4605-b1b7-3ebfde0618e8 req-d9d67954-6c8b-4eda-bd68-350cfe05b211 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received unexpected event network-vif-plugged-6840ddab-3472-4eb0-99b3-2574a3218221 for instance with vm_state active and task_state None.
May 14 03:50:40.564467 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:40.566623 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730640.566374, eac6d4d5-5e59-4f66-bdca-1edd074e3425 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:40.566874 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] VM Resumed (Lifecycle Event)
May 14 03:50:40.588032 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Took 15.70 seconds to build instance.
May 14 03:50:40.690187 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1330432825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testservervolumeattachscenariooldversion-server-1330432',id=72,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN1b5rR6WLACt9VRpqF1hj9rNNAEljV2pDPKLr7n9AzV4jtwEJgCJobpOuW0U69ljE4PzOzLiBqIQiTbJ/w9KS5QHadwQCxauaejESIcFmV2yJrB9eZjGIGAz4PLol7jg==',key_name='tempest-keypair-693589667',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:49:44Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d6f0014a3d247b496b2a4a9181936b0',ramdisk_id='',reservation_id='r-k44ua4j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54283c49dc2245a393345e5b881bff95',uuid=076da36f-3685-4e03-b748-e158fb0c9c00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:50:40.690382 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converting VIF {"id": "6e282dad-971a-4b48-8fb7-29806f783939", "address": "fa:16:3e:90:ce:2d", "network": {"id": "5ecf92c4-0b46-46ff-826f-04eb9f068ff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1460904606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6f0014a3d247b496b2a4a9181936b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e282dad-97", "ovs_interfaceid": "6e282dad-971a-4b48-8fb7-29806f783939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:50:40.690958 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:50:40.691214 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:50:40.692482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.692686 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e282dad-97, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.694051 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.694940 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:40.699912 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.700710 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.700865 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef919e61-dd2b-43cb-ba57-3a4c1dad3014) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:50:40.701553 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.702083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:50:40.706652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:40.709009 np0000000741 nova-compute[97948]: INFO os_vif [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:ce:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e282dad-971a-4b48-8fb7-29806f783939,network=Network(5ecf92c4-0b46-46ff-826f-04eb9f068ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e282dad-97')
May 14 03:50:40.709320 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Deleting instance files /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00_del
May 14 03:50:40.710094 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Deletion of /opt/stack/data/nova/instances/076da36f-3685-4e03-b748-e158fb0c9c00_del complete
May 14 03:50:40.783479 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:50:40.783624 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97948) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 03:50:41.069533 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:41.071807 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:41.089300 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-95b97e29-6ae8-4a46-b69c-e8dfff3c251f tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.203s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:41.215569 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 03:50:41.216244 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:50:41.216681 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:50:41.216898 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:50:41.217337 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:41.285399 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:50:41.325387 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:41.574281 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999722418999681 future=<Future at 0x79d0b82b8710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:41.575301 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998678643999938 future=<Future at 0x79d0b82b8710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:41.575474 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998548432999996 future=<Future at 0x79d0b82b8710 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:41.700817 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:41.781587 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a45f5f27-e608-4cd9-9835-2a13e7645549 req-c9bec895-17cf-43a6-89f1-e6582db118c5 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-deleted-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:41.782655 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-a45f5f27-e608-4cd9-9835-2a13e7645549 req-c9bec895-17cf-43a6-89f1-e6582db118c5 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Neutron deleted interface 6e282dad-971a-4b48-8fb7-29806f783939; detaching it from the instance and deleting it from the info cache
May 14 03:50:41.782874 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-a45f5f27-e608-4cd9-9835-2a13e7645549 req-c9bec895-17cf-43a6-89f1-e6582db118c5 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:41.943847 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:41.943964 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:50:41.944109 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No VIF found with MAC fa:16:3e:5f:c2:6b, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:50:41.944518 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Using config drive
May 14 03:50:42.116953 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:42.117321 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] Acquiring lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:42.117479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:42.117601 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] Lock "076da36f-3685-4e03-b748-e158fb0c9c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:42.118156 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] No waiting events found dispatching network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:42.118281 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-95caad69-5e4d-4897-83ac-7423f0ecd6c1 req-2e1fe039-7d28-4198-92aa-09aefac15842 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Received event network-vif-unplugged-6e282dad-971a-4b48-8fb7-29806f783939 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:50:42.236221 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:42.286096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-a45f5f27-e608-4cd9-9835-2a13e7645549 req-c9bec895-17cf-43a6-89f1-e6582db118c5 service nova] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Detach interface failed, port_id=6e282dad-971a-4b48-8fb7-29806f783939, reason: Instance 076da36f-3685-4e03-b748-e158fb0c9c00 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:50:42.453807 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:42.601579 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Creating config drive at /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/disk.config
May 14 03:50:42.605821 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjuulvoa {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:50:42.677851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjuulvoa" returned: 0 in 0.072s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:50:42.738628 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Took 1.52 seconds to deallocate network for instance.
May 14 03:50:43.089442 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.112585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.117775 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.236721 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.248664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:43.248664 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:43.419598 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.423911 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.449936 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:43.641113 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:50:43.641375 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:50:43.837712 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:43.838275 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:43.838596 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:43.838866 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:43.839090 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Processing event network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:50:43.839313 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:43.839520 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:50:43.839730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:50:43.839907 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:43.840772 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] No waiting events found dispatching network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:50:43.841086 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-fc7c5823-37dc-449e-9b86-3f55f90e8bc3 req-a5c2625c-5e55-4497-b6c2-afa894a033dc service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received unexpected event network-vif-plugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f for instance with vm_state building and task_state spawning.
May 14 03:50:43.877305 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730643.8768356, 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:43.877778 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:50:43.877959 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] VM Started (Lifecycle Event)
May 14 03:50:43.882302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:50:43.884973 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance spawned successfully.
May 14 03:50:43.885304 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:50:43.965843 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:44.147508 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:50:44.194007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:44.194494 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing instance network info cache due to event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:44.194730 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] Acquiring lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:44.194828 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] Acquired lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:44.194961 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:44.380874 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:44.383166 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:44.391219 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.391395 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.391747 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.392022 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.392323 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.392612 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:50:44.660010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.413s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:44.697414 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:44.711105 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Deleted allocations for instance 076da36f-3685-4e03-b748-e158fb0c9c00
May 14 03:50:44.886882 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:50:44.887190 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730644.8870058, 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:44.887380 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] VM Paused (Lifecycle Event)
May 14 03:50:44.897398 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Took 8.71 seconds to spawn the instance on the hypervisor.
May 14 03:50:44.897966 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:45.016416 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:45.131136 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updated VIF entry in instance network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:50:45.131409 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:45.389631 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:45.391650 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730645.3914285, 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:45.391846 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] VM Resumed (Lifecycle Event)
May 14 03:50:45.410454 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Took 15.82 seconds to build instance.
May 14 03:50:45.633434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-726fa367-7df0-420f-97f9-e15e4f581cbe req-a61e6f0a-2b82-433c-8d0d-352e91088a76 service nova] Releasing lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:45.701913 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:45.719674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-ba2dc246-8320-4e12-9536-3e27e2ee9b6a tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Lock "076da36f-3685-4e03-b748-e158fb0c9c00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.376s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:45.894177 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:45.896393 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:50:45.911892 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1ebf7e7b-ff6b-4b89-8b23-ade675473a24 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.335s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:50:46.446562 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-changed-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:50:46.447105 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Refreshing instance network info cache due to event network-changed-400adc7c-85ac-46d1-b0ef-9fac13a3f90f. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:50:46.447105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] Acquiring lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:50:46.447105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] Acquired lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:50:46.447320 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Refreshing network info cache for port 400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:50:46.949395 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:47.309653 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:50:47.460171 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updated VIF entry in instance network info cache for port 400adc7c-85ac-46d1-b0ef-9fac13a3f90f. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:50:47.460548 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updating instance_info_cache with network_info: [{"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:50:47.637244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:47.962403 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8cd1a7e4-7fee-4cbd-85f9-a0b719163c53 req-ddbb2532-70db-4ab2-88e1-c5700a028c84 service nova] Releasing lock "refresh_cache-3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:50:48.967584 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:49.829097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:50.702378 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:53.968802 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:55.702998 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:50:56.574400 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00040049700010058586 future=<Future at 0x79d0b82b8710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:56.574744 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730641.573897, 076da36f-3685-4e03-b748-e158fb0c9c00 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:50:56.574892 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:50:56.575011 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] VM Stopped (Lifecycle Event)
May 14 03:50:57.078026 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 076da36f-3685-4e03-b748-e158fb0c9c00] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:50:58.970344 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:00.703476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:03.971451 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:05.704518 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:07.286885 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:08.973436 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:09.563215 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:10.705986 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:10.870190 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:10.870343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:10.870494 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:10.870650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:10.870827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:10.872834 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Terminating instance
May 14 03:51:11.375338 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:51:11.394292 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.401067 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.414847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.420838 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.441142 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.448772 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:11.692437 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999767200000406 future=<Future at 0x79d0b07740e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:11.693400 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998828168000273 future=<Future at 0x79d0b07740e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:11.693625 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998554573000092 future=<Future at 0x79d0b07740e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:11.695624 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Instance destroyed successfully.
May 14 03:51:11.695985 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lazy-loading 'resources' on Instance uuid 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:51:11.931827 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:12.198595 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1162676206',display_name='tempest-TestEncryptedCinderVolumes-server-1162676206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testencryptedcindervolumes-server-1162676206',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiXlxugF1QPgEfD8BD8hRkFq6zME94V9TfbQpFKIDdS2b2X7De8oyZROma4MVOXDWhPwsGNSjikBlSv3hgN+KKMjuzquRGesfJ0YRekHTMBKcteXW+CINnFB8bTagyN/A==',key_name='tempest-TestEncryptedCinderVolumes-591205341',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:50:31Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71fb53bd4f2841db99df994d7e6c2a72',ramdisk_id='',reservation_id='r-f7op1itg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-2068807358',owner_user_name='tempest-TestEncryptedCinderVolumes-2068807358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:50:31Z,user_data=None,user_id='05ce7f78f81b4fe780ebc7a1d615a0ec',uuid=49c8d02e-6d1d-4af3-bd13-4c63765c5c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:51:12.198973 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converting VIF {"id": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "address": "fa:16:3e:34:a1:25", "network": {"id": "4421325a-ef15-4946-a2b4-6bc98edb9a82", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-723722608-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71fb53bd4f2841db99df994d7e6c2a72", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2153eb-58", "ovs_interfaceid": "5b2153eb-58dc-4ab9-8a13-db35c4cfc701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:12.199788 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:12.200104 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:51:12.201759 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:12.201989 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2153eb-58, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:12.204980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:12.205623 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:12.205769 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ff3ed9b-87bd-4041-aa1b-7c1520dd4db0) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:12.207746 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:12.217337 np0000000741 nova-compute[97948]: INFO os_vif [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701,network=Network(4421325a-ef15-4946-a2b4-6bc98edb9a82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2153eb-58')
May 14 03:51:12.223175 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:51:12.223629 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:51:12.223843 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:12.224362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:12.224851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06c98c12-5547-43ab-a483-7ed8d262c41e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:51:12.225176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:12.255935 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:12.256171 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:12.256315 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:51:12.256466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '191')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:12.257829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e', '192')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:12.258983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b815ce00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:51:12.259249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Removing multipathed devices sdf, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:51:12.259654 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Flush multipath device 330000000566c5ff3 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:51:12.291760 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:12.350317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:12.401186 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:51:12.401341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:51:12.402568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:51:12.420148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:51:12.420369 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:51:12.431753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.465891 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.40.100,3260]
May 14 03:51:12.465891 np0000000741 nova-compute[97948]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.40.100,3260] successful.
May 14 03:51:12.465891 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.482827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.494761 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.533790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.50.100,3260]
May 14 03:51:12.533790 np0000000741 nova-compute[97948]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-06c98c12-5547-43ab-a483-7ed8d262c41e, portal: 192.168.50.100,3260] successful.
May 14 03:51:12.533790 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.549084 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:12.549929 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:12.550103 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] <== disconnect_volume: return (326ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:51:12.550268 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:51:12.550568 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Deleting instance files /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04_del
May 14 03:51:12.551116 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Deletion of /opt/stack/data/nova/instances/49c8d02e-6d1d-4af3-bd13-4c63765c5c04_del complete
May 14 03:51:13.057014 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Took 1.68 seconds to destroy the instance on the hypervisor.
May 14 03:51:13.057584 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:51:13.057913 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:51:13.058021 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:51:13.058222 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:13.130417 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:13.414879 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:13.595077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac9725ba-e20f-49dc-a6c0-c9dcffa32d6c req-6e4d12e9-7ed6-4f7e-8f67-3a68c61437b1 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Received event network-vif-deleted-5b2153eb-58dc-4ab9-8a13-db35c4cfc701 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:13.595225 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-ac9725ba-e20f-49dc-a6c0-c9dcffa32d6c req-6e4d12e9-7ed6-4f7e-8f67-3a68c61437b1 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Neutron deleted interface 5b2153eb-58dc-4ab9-8a13-db35c4cfc701; detaching it from the instance and deleting it from the info cache
May 14 03:51:13.595339 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ac9725ba-e20f-49dc-a6c0-c9dcffa32d6c req-6e4d12e9-7ed6-4f7e-8f67-3a68c61437b1 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:13.974372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:14.043773 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:14.099565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ac9725ba-e20f-49dc-a6c0-c9dcffa32d6c req-6e4d12e9-7ed6-4f7e-8f67-3a68c61437b1 service nova] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Detach interface failed, port_id=5b2153eb-58dc-4ab9-8a13-db35c4cfc701, reason: Instance 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:51:14.546200 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Took 1.49 seconds to deallocate network for instance.
May 14 03:51:15.091222 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Took 0.54 seconds to detach 1 volumes for instance.
May 14 03:51:15.599532 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:15.599934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:15.644505 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Refreshing inventories for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 03:51:15.683157 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Updating ProviderTree inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 03:51:15.683307 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:51:15.721220 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Refreshing aggregate associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, aggregates: None {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 03:51:15.764887 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Refreshing trait associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_MIPSEL,COMPUTE_NODE,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_AARCH64,COMPUTE_ARCH_RISCV64 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 03:51:15.982114 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:15.982356 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:16.485110 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:16.833162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:16.833542 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:16.990813 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.391s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:17.033435 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Deleted allocations for instance 49c8d02e-6d1d-4af3-bd13-4c63765c5c04
May 14 03:51:17.207115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:17.336127 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:51:17.878074 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:17.878375 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:17.881584 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:51:17.881745 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Claim successful on node np0000000741
May 14 03:51:18.040738 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63c5cfbb-8c34-4157-8ee6-7d5ee1f00f59 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Lock "49c8d02e-6d1d-4af3-bd13-4c63765c5c04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.170s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:18.976176 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:19.087998 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:19.088196 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:19.275571 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:19.275960 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing instance network info cache due to event network-changed-6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:19.276162 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] Acquiring lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:19.276280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] Acquired lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:19.276406 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Refreshing network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:19.590515 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:19.781789 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:19.783694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:19.783970 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:19.784173 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:19.784310 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:19.784562 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:19.786453 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Terminating instance
May 14 03:51:20.045069 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:20.096884 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:20.096884 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:51:20.195156 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updated VIF entry in instance network info cache for port 6840ddab-3472-4eb0-99b3-2574a3218221. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:51:20.195529 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [{"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:20.290294 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:51:20.320612 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:20.323195 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:20.341517 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:20.442244 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:20.449094 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:20.463664 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:20.464156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:20.464156 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:20.464260 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:20.464396 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] No waiting events found dispatching network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:20.464616 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eaa362e2-a28b-4b3f-a95d-b64c5821cf5d req-b4cff01d-c143-42a5-85d9-e02e803bde68 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:51:20.602213 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:51:20.602577 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:51:20.602821 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:20.603179 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:20.615131 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999695647999943 future=<Future at 0x79d0b85e2990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:20.616266 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Instance destroyed successfully.
May 14 03:51:20.616871 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid eac6d4d5-5e59-4f66-bdca-1edd074e3425 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:51:20.667867 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27cad4e205374f8b8879c440af287684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2107e69e4f24f49ad24e398462243ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:51:20.697299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-29dc1d83-be1f-4625-8ae6-167037a4e4ad req-090bec3c-b01c-4307-8840-f948d9e897e4 service nova] Releasing lock "refresh_cache-eac6d4d5-5e59-4f66-bdca-1edd074e3425" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:21.046787 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Successfully created port: f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:51:21.105664 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:51:21.118821 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1914793910',display_name='tempest-TestVolumeBootPattern-server-1914793910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-1914793910',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:50:40Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-yomp0wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:50:40Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=eac6d4d5-5e59-4f66-bdca-1edd074e3425,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:51:21.119032 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "6840ddab-3472-4eb0-99b3-2574a3218221", "address": "fa:16:3e:0a:1e:68", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6840ddab-34", "ovs_interfaceid": "6840ddab-3472-4eb0-99b3-2574a3218221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:21.119731 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:21.119996 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:51:21.122071 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:21.122241 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6840ddab-34, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:21.124243 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:21.125480 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:21.126837 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:21.127015 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce309527-e950-4472-aac8-e266501d8e9e) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:21.127585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:21.128209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:21.129936 np0000000741 nova-compute[97948]: INFO os_vif [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:1e:68,bridge_name='br-int',has_traffic_filtering=True,id=6840ddab-3472-4eb0-99b3-2574a3218221,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6840ddab-34')
May 14 03:51:21.131495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:51:21.131780 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:51:21.131973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:21.132274 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:21.132568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '201eb018-8e5c-4198-99f4-472e88c7c417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:51:21.132759 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:21.156542 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417 (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:21.156816 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:21.156816 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:51:21.157015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '195')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:21.157699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417', '196')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:21.158401 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0907c2de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'): ({'sdi'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:51:21.158574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdh, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:51:21.158764 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000ab95b618 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:51:21.217322 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:21.279522 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:21.339449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:51:21.339706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:51:21.341126 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:51:21.353605 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:51:21.353739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:51:21.365121 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.393746 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.40.100,3260]
May 14 03:51:21.393746 np0000000741 nova-compute[97948]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.40.100,3260] successful.
May 14 03:51:21.393746 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.408105 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.419248 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.456549 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.50.100,3260]
May 14 03:51:21.456549 np0000000741 nova-compute[97948]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-201eb018-8e5c-4198-99f4-472e88c7c417, portal: 192.168.50.100,3260] successful.
May 14 03:51:21.456549 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.470421 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:21.470610 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:21.470741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (339ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:51:21.470842 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:51:21.471093 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Deleting instance files /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425_del
May 14 03:51:21.471538 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Deletion of /opt/stack/data/nova/instances/eac6d4d5-5e59-4f66-bdca-1edd074e3425_del complete
May 14 03:51:21.483619 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Successfully updated port: f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:51:21.609026 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:51:21.976956 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Took 1.69 seconds to destroy the instance on the hypervisor.
May 14 03:51:21.977448 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:51:21.977677 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:51:21.977765 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:51:21.977949 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:21.985546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:21.985692 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquired lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:21.985876 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:51:22.032199 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:22.244807 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eafd9f8a-a17b-4cac-a855-0de56aae1081 req-05a15f00-4c39-4026-896e-b82ceec721bf service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-deleted-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:22.245196 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-eafd9f8a-a17b-4cac-a855-0de56aae1081 req-05a15f00-4c39-4026-896e-b82ceec721bf service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Neutron deleted interface 6840ddab-3472-4eb0-99b3-2574a3218221; detaching it from the instance and deleting it from the info cache
May 14 03:51:22.245297 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-eafd9f8a-a17b-4cac-a855-0de56aae1081 req-05a15f00-4c39-4026-896e-b82ceec721bf service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:22.526286 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:22.526522 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Acquiring lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:22.526720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:22.526870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:22.527024 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] No waiting events found dispatching network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:22.527195 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Received event network-vif-unplugged-6840ddab-3472-4eb0-99b3-2574a3218221 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:51:22.527340 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:22.527476 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing instance network info cache due to event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:22.527619 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Acquiring lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:22.569546 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:51:22.617450 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:51:22.618353 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:51:22.618465 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Creating image(s)
May 14 03:51:22.618851 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:22.618991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:22.619388 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:22.619949 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:51:22.622552 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:51:22.623513 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:22.684359 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:22.702532 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:22.722455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:22.723218 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:22.723993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:22.724398 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:51:22.728475 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:51:22.729990 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:22.732200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:22.762695 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-eafd9f8a-a17b-4cac-a855-0de56aae1081 req-05a15f00-4c39-4026-896e-b82ceec721bf service nova] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Detach interface failed, port_id=6840ddab-3472-4eb0-99b3-2574a3218221, reason: Instance eac6d4d5-5e59-4f66-bdca-1edd074e3425 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:51:22.821693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:22.822089 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:22.882991 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk 1073741824" returned: 0 in 0.061s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:22.883546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:22.883921 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:22.901854 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating instance_info_cache with network_info: [{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:22.978411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:22.978938 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:51:22.979193 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:23.077942 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:23.078476 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Cannot resize image /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:51:23.079009 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:51:23.079262 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Ensure instance console log exists: /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:51:23.079620 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:23.079987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:23.080078 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:23.206568 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Took 1.23 seconds to deallocate network for instance.
May 14 03:51:23.405596 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Releasing lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:23.406047 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Instance network_info: |[{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:51:23.406547 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Acquired lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:23.406801 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:23.409341 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Start _get_guest_xml network_info=[{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:51:23.414912 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:51:23.416343 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1136494025', uuid='a48e0d44-3f51-427a-9204-24e2a87f8f9a'), owner=OwnerMeta(userid='27cad4e205374f8b8879c440af287684', username='tempest-VolumeMultiattachTests-1122220317-project-member', projectid='e2107e69e4f24f49ad24e398462243ac', projectname='tempest-VolumeMultiattachTests-1122220317'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730683.4159744) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:51:23.417708 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:51:23.418050 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:51:23.419213 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:51:23.419450 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:51:23.420358 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:51:23.420673 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:51:23.422226 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:51:23.422390 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:51:23.422514 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:51:23.422600 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:51:23.422709 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:51:23.422973 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:51:23.423242 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:51:23.423242 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:51:23.423333 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:51:23.423485 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:51:23.440727 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1136494025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1136494025',id=76,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-vxznk3qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=a48e0d44-3f51-427a-9204-24e2a87f8f9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:51:23.440727 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:23.440727 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:23.441371 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'pci_devices' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:51:23.749968 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Took 0.54 seconds to detach 1 volumes for instance.
May 14 03:51:23.911065 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:23.943889 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] End _get_guest_xml xml=<domain type="qemu">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <uuid>a48e0d44-3f51-427a-9204-24e2a87f8f9a</uuid>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <name>instance-0000004c</name>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumeMultiattachTests-server-1136494025</nova:name>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:51:23</nova:creationTime>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:user uuid="27cad4e205374f8b8879c440af287684">tempest-VolumeMultiattachTests-1122220317-project-member</nova:user>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:project uuid="e2107e69e4f24f49ad24e398462243ac">tempest-VolumeMultiattachTests-1122220317</nova:project>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         <nova:port uuid="f11bdd3e-60c3-4754-80a8-7bd20f9fe014">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <system>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="serial">a48e0d44-3f51-427a-9204-24e2a87f8f9a</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="uuid">a48e0d44-3f51-427a-9204-24e2a87f8f9a</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </system>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <os>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </os>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <features>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </features>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   <devices>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </disk>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.config"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </disk>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:7d:0e:28"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <target dev="tapf11bdd3e-60"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </interface>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/console.log" append="off"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </serial>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <video>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </video>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </rng>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:   </devices>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]: </domain>
May 14 03:51:23.943889 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Preparing to wait for external event network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1136494025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1136494025',id=76,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-vxznk3qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=a48e0d44-3f51-427a-9204-24e2a87f8f9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:23.945554 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:23.945821 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:51:23.946482 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.946807 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:23.947064 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:51:23.947894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.947894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5be75837-8dc2-5814-b3db-bded65d485a5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:23.948561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.949169 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:23.949331 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.951019 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.951163 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf11bdd3e-60, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:23.951474 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf11bdd3e-60, col_values=(('qos', UUID('1ec2da7b-0fe0-4964-8630-01ae03a0f3b0')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:23.951661 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf11bdd3e-60, col_values=(('external_ids', {'iface-id': 'f11bdd3e-60c3-4754-80a8-7bd20f9fe014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:0e:28', 'vm-uuid': 'a48e0d44-3f51-427a-9204-24e2a87f8f9a'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:23.952300 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.953255 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:23.958110 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:23.959748 np0000000741 nova-compute[97948]: INFO os_vif [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60')
May 14 03:51:23.976441 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:24.191738 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:24.253124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:24.255766 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:24.255923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:24.315211 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updated VIF entry in instance network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:51:24.315445 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating instance_info_cache with network_info: [{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:24.479932 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:24.480278 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:24.817385 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6fe89085-222d-41a9-9181-4f40d5249067 req-5ac01953-26f9-49ef-b58d-357dbe8ad9e3 service nova] Releasing lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:24.982494 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:25.479075 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:51:25.479075 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:51:25.479502 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:7d:0e:28, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:51:25.479713 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Using config drive
May 14 03:51:25.489048 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:25.532372 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance eac6d4d5-5e59-4f66-bdca-1edd074e3425
May 14 03:51:25.984315 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:26.090976 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Creating config drive at /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.config
May 14 03:51:26.094451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuagdntzj {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:26.147758 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuagdntzj" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:26.522522 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:26.544200 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:26.548005 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5f961631-cece-491b-bf15-e71a65196515 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "eac6d4d5-5e59-4f66-bdca-1edd074e3425" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.763s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:26.627070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:26.692652 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004342899997027416 future=<Future at 0x79d0b07740e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:26.693206 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:26.693206 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.921677058000114 future=<Future at 0x79d0b85e2990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:26.693206 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=8.921595906999755 future=<Future at 0x79d0b85e2990 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:26.693660 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] Emitting event <LifecycleEvent: 1778730671.6921191, 49c8d02e-6d1d-4af3-bd13-4c63765c5c04 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:26.693808 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] VM Stopped (Lifecycle Event)
May 14 03:51:26.715923 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-274698f9-1990-4852-8831-ca74d96dd514 req-acbbd25b-fcf4-400e-bbd6-6acd03dcf6d6 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:26.716783 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-274698f9-1990-4852-8831-ca74d96dd514 req-acbbd25b-fcf4-400e-bbd6-6acd03dcf6d6 service nova] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:26.716995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-274698f9-1990-4852-8831-ca74d96dd514 req-acbbd25b-fcf4-400e-bbd6-6acd03dcf6d6 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:26.717107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-274698f9-1990-4852-8831-ca74d96dd514 req-acbbd25b-fcf4-400e-bbd6-6acd03dcf6d6 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:26.717325 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-274698f9-1990-4852-8831-ca74d96dd514 req-acbbd25b-fcf4-400e-bbd6-6acd03dcf6d6 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Processing event network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:51:26.819980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:26.843980 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:27.196770 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-69ab6bf3-eda6-427c-9581-15f6c880b764 tempest-TestEncryptedCinderVolumes-2068807358 tempest-TestEncryptedCinderVolumes-2068807358-project-member] [instance: 49c8d02e-6d1d-4af3-bd13-4c63765c5c04] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:27.234694 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730687.2343338, a48e0d44-3f51-427a-9204-24e2a87f8f9a => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:27.235076 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:51:27.235252 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] VM Started (Lifecycle Event)
May 14 03:51:27.237466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:51:27.239872 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Instance spawned successfully.
May 14 03:51:27.242387 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:51:27.739362 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:27.745833 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:51:27.751012 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:27.751144 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:27.751481 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:27.751839 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:27.752059 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:27.752288 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:28.250463 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:51:28.250463 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730688.249778, a48e0d44-3f51-427a-9204-24e2a87f8f9a => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:28.250463 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] VM Paused (Lifecycle Event)
May 14 03:51:28.256890 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Took 5.64 seconds to spawn the instance on the hypervisor.
May 14 03:51:28.257109 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:28.693506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:28.693711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:28.752613 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:28.756358 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730688.756108, a48e0d44-3f51-427a-9204-24e2a87f8f9a => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:28.756934 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] VM Resumed (Lifecycle Event)
May 14 03:51:28.766519 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Took 10.93 seconds to build instance.
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] No waiting events found dispatching network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:28.771888 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received unexpected event network-vif-plugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 for instance with vm_state active and task_state None.
May 14 03:51:28.772716 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:28.772979 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing instance network info cache due to event network-changed-a7da705c-d6d0-45a4-ab6c-b23990888769. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:28.773592 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Acquiring lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:28.773809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Acquired lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:28.774047 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Refreshing network info cache for port a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:28.953305 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:28.978223 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.132703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:29.132883 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:29.132997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:29.133109 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:29.133200 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:29.135178 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Terminating instance
May 14 03:51:29.195455 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:51:29.260400 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:29.267052 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:51:29.268943 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-651ffa9b-1042-4527-a67e-1ed60ff73c46 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.435s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:29.279666 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:29.285376 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:29.285793 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:29.632717 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:29.639176 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:51:29.663143 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.681454 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.686543 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.703669 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.706506 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:29.757396 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:29.757788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:29.761672 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:51:29.761672 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Claim successful on node np0000000741
May 14 03:51:29.784560 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:29.784729 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:29.829560 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updated VIF entry in instance network info cache for port a7da705c-d6d0-45a4-ab6c-b23990888769. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:51:29.829560 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [{"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:29.911946 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:29.912061 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing instance network info cache due to event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:29.912225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] Acquiring lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:29.912225 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] Acquired lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:29.912398 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:29.916660 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:29.916843 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:29.917044 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:29.917107 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:29.917591 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] No waiting events found dispatching network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:29.917591 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1f69d4e3-2bff-4e23-a2cd-485cdcc9a69d req-025e44ce-b2d5-47a6-8af8-c170330fb1cc service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:51:29.974115 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99972139600004 future=<Future at 0x79d0b0787170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:29.976318 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Instance destroyed successfully.
May 14 03:51:29.976801 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lazy-loading 'resources' on Instance uuid 6b67511f-42d0-418f-8315-3072389f618b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:51:30.330705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-4adc3601-beef-497d-a4fb-c1a5f7234a99 req-7b340876-3d03-40f8-b314-9ff6d901ee93 service nova] Releasing lock "refresh_cache-6b67511f-42d0-418f-8315-3072389f618b" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:30.415200 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:30.479358 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-248102859',display_name='tempest-TestVolumeBootPattern-server-248102859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpattern-server-248102859',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiDXeKfnmsYb00MfDqrcRJ4V3LPEdThn3YQzd4JIvjI+bNwEmMQWd/lNWVemlWhGMW5quQj07K3Xt58lNzacb/Tiz+xGLdlUwvL31mxxUWSJE1CjlltcKK4uA0OQYk/kw==',key_name='tempest-TestVolumeBootPattern-1445276494',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:49:40Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f55f169d311447d9a628b9ab9e7f4a6',ramdisk_id='',reservation_id='r-f2ek4b8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1781728370',owner_user_name='tempest-TestVolumeBootPattern-1781728370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:49:41Z,user_data=None,user_id='d8406aaa75274bfa842bca7d95576f02',uuid=6b67511f-42d0-418f-8315-3072389f618b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:51:30.479625 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converting VIF {"id": "a7da705c-d6d0-45a4-ab6c-b23990888769", "address": "fa:16:3e:87:a6:ae", "network": {"id": "79c05981-9759-46f7-bd8d-36815799baa2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1023374017-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2f55f169d311447d9a628b9ab9e7f4a6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7da705c-d6", "ovs_interfaceid": "a7da705c-d6d0-45a4-ab6c-b23990888769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:30.480509 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:30.480840 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:51:30.482518 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.482864 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7da705c-d6, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:30.483926 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.485047 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:30.485844 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.486541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.486541 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24ab26a0-8a18-44ce-be1e-ee87f3e29748) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:30.487458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.487458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:30.488201 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:30.490134 np0000000741 nova-compute[97948]: INFO os_vif [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:a6:ae,bridge_name='br-int',has_traffic_filtering=True,id=a7da705c-d6d0-45a4-ab6c-b23990888769,network=Network(79c05981-9759-46f7-bd8d-36815799baa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7da705c-d6')
May 14 03:51:30.491816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:51:30.492102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:51:30.492241 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:30.492586 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:30.492872 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53aefc7f-07a2-4196-9807-3e01796cb61c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:51:30.493004 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:51:30.518616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:30.518616 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:30.518616 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:30.518616 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:30.518616 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:30.518857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:30.518857 np0000000741 nova-compute[97948]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c (non-flash)
May 14 03:51:30.518857 np0000000741 nova-compute[97948]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:30.518857 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:30.518857 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:30.518857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:51:30.518996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '179')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:30.519678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c', '180')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:51:30.520267 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b85fafc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:51:30.520443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:51:30.520627 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Flush multipath device 330000000afbfdd02 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:51:30.571800 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:30.615664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:51:30.652962 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:51:30.653132 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:51:30.653979 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:51:30.664518 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:51:30.664736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:51:30.675088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.699482 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:30.705501 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260]
May 14 03:51:30.705501 np0000000741 nova-compute[97948]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.40.100,3260] successful.
May 14 03:51:30.705501 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.720813 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.733173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.759775 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260]
May 14 03:51:30.759775 np0000000741 nova-compute[97948]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-53aefc7f-07a2-4196-9807-3e01796cb61c, portal: 192.168.50.100,3260] successful.
May 14 03:51:30.759775 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.772757 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:30.772955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:30.773069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] <== disconnect_volume: return (280ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:51:30.773171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:51:30.773442 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Deleting instance files /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b_del
May 14 03:51:30.773900 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Deletion of /opt/stack/data/nova/instances/6b67511f-42d0-418f-8315-3072389f618b_del complete
May 14 03:51:30.838797 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updated VIF entry in instance network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:51:30.839215 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating instance_info_cache with network_info: [{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:30.981834 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:30.981834 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:31.279295 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Took 1.64 seconds to destroy the instance on the hypervisor.
May 14 03:51:31.279885 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:51:31.280208 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:51:31.280291 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:51:31.280495 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:31.334612 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:31.340951 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c8a2f23a-fcb6-4524-a4f4-d2b0e85333b9 req-47475311-4d07-4cf6-ba58-1bffb6274cd4 service nova] Releasing lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:31.483961 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:31.595237 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0188f64-e273-4737-aa52-9a10c6e2ab9f req-885072a6-a5c3-437c-85d0-a3470f10ab03 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-deleted-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:31.596017 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-b0188f64-e273-4737-aa52-9a10c6e2ab9f req-885072a6-a5c3-437c-85d0-a3470f10ab03 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Neutron deleted interface a7da705c-d6d0-45a4-ab6c-b23990888769; detaching it from the instance and deleting it from the info cache
May 14 03:51:31.596145 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-b0188f64-e273-4737-aa52-9a10c6e2ab9f req-885072a6-a5c3-437c-85d0-a3470f10ab03 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:31.783241 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:31.783619 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:31.971042 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:31.971236 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] Acquiring lock "6b67511f-42d0-418f-8315-3072389f618b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:31.971415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:31.971566 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] Lock "6b67511f-42d0-418f-8315-3072389f618b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:31.971740 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] No waiting events found dispatching network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:31.971893 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e8984788-991f-4a07-877c-3f9191b10cbb req-99cd62a0-ca57-42e9-b651-ed1764e7805f service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Received event network-vif-unplugged-a7da705c-d6d0-45a4-ab6c-b23990888769 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:51:31.992356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.235s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:31.992620 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:51:32.052143 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:32.100335 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-b0188f64-e273-4737-aa52-9a10c6e2ab9f req-885072a6-a5c3-437c-85d0-a3470f10ab03 service nova] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Detach interface failed, port_id=a7da705c-d6d0-45a4-ab6c-b23990888769, reason: Instance 6b67511f-42d0-418f-8315-3072389f618b could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:51:32.497751 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:51:32.501658 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:51:32.501658 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:32.501658 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:32.553891 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Took 1.27 seconds to deallocate network for instance.
May 14 03:51:32.569897 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1502fd1ebb564a38a0329ad56584a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963dbf38a7f450c88af23dc0786e125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:51:32.783111 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:32.783474 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:51:32.784040 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:32.999225 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:51:33.010416 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Successfully created port: 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:51:33.102106 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:51:33.439678 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Successfully updated port: 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:51:33.501928 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:51:33.610953 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:33.611139 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:33.649702 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-changed-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:33.650051 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Refreshing instance network info cache due to event network-changed-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:33.650251 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] Acquiring lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:33.650394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] Acquired lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:33.650474 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Refreshing network info cache for port 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:33.783073 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:33.845666 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:33.846043 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:33.942904 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:33.979674 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:34.007464 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Booting with volume b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 at /dev/vda
May 14 03:51:34.044251 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:51:34.053833 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:51:34.072463 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:34.116473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:51:34.116779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:51:34.125470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:51:34.126954 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63'] 
May 14 03:51:34.127202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:51:34.127363 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:51:34.127829 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:51:34.128167 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating existing volume attachment record: b6369c9b-95af-4e0f-8912-dd33596b6551 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:51:34.152816 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:34.211982 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:51:34.287290 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:34.326771 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:34.348465 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:34.828864 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aaabf623-d89d-4038-b063-97bf57e5bc14 req-73ccb6b1-8c18-49df-b03a-1854a59f0da9 service nova] Releasing lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:34.829305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquired lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:34.829473 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:51:34.856003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.245s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:34.857609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.569s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:34.857848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:34.858096 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:51:34.908554 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Deleted allocations for instance 6b67511f-42d0-418f-8315-3072389f618b
May 14 03:51:35.394033 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:51:35.487180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:35.555899 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:35.615268 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004210120000607276 future=<Future at 0x79d0b85e2990 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:35.615398 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:35.615485 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.358308714000032 future=<Future at 0x79d0b0787170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:35.615585 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=9.358200675000262 future=<Future at 0x79d0b0787170 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:35.616307 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Emitting event <LifecycleEvent: 1778730680.6147375, eac6d4d5-5e59-4f66-bdca-1edd074e3425 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:35.616949 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] VM Stopped (Lifecycle Event)
May 14 03:51:35.676024 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating instance_info_cache with network_info: [{"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:35.884632 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:51:35.886201 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:35.925299 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-0c241561-b219-4d49-a01e-cb2e37a8666e tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] Lock "6b67511f-42d0-418f-8315-3072389f618b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.792s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:35.980506 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:35.980912 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:36.086919 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:36.091390 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:51:36.092575 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:36.123711 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-007789d9-e218-4899-95c7-2b1e3825e130 tempest-TestVolumeBootPattern-1781728370 tempest-TestVolumeBootPattern-1781728370-project-member] [instance: eac6d4d5-5e59-4f66-bdca-1edd074e3425] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:36.141690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:36.142016 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13636MB free_disk=72.71536254882812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:51:36.142172 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:36.142379 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:36.179010 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Releasing lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:36.179717 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance network_info: |[{"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:51:36.228274 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:51:36.229984 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:51:36.230214 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Creating image(s)
May 14 03:51:36.230472 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:51:36.230599 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Ensure instance console log exists: /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:51:36.230837 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:36.230999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:36.231181 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:36.231617 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Start _get_guest_xml network_info=[{"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d29382d-ccc4-4065-9351-d448a9e7d199', 'attached_at': '', 'detached_at': '', 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'serial': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'}, 'boot_index': 0, 'attachment_id': 'b6369c9b-95af-4e0f-8912-dd33596b6551', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:51:36.233834 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:51:36.234788 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1620839996', uuid='0d29382d-ccc4-4065-9351-d448a9e7d199'), owner=OwnerMeta(userid='1502fd1ebb564a38a0329ad56584a769', username='tempest-TestVolumeBootPatternV346-1499777380-project-member', projectid='d963dbf38a7f450c88af23dc0786e125', projectname='tempest-TestVolumeBootPatternV346-1499777380'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730696.2344456) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:51:36.235891 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:51:36.236211 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:51:36.237052 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:51:36.237221 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:51:36.238008 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:51:36.238268 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:51:36.238397 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:51:36.238503 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:51:36.238620 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:51:36.238726 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:51:36.238833 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:51:36.238968 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:51:36.239063 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:51:36.239174 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:51:36.239267 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:51:36.239367 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:51:36.248250 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:51:36.248577 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:51:36.248730 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:36.249063 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:36.249372 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:51:36.260774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:36.261305 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:51:36.261648 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:36.261839 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:51:36.262385 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:51:36.262385 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:51:36.274269 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:51:36.274269 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:36.284660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:51:36.284660 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:36.286997 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1] added
May 14 03:51:36.286997 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:51:36.286997 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:51:36.286997 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:51:36.286997 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:51:36.286997 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:51:36.286997 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:36.287316 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:51:36.288067 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:51:36.288225 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:51:36.298757 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1] added
May 14 03:51:36.298757 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:51:36.298757 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:51:36.298757 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:51:36.298757 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:51:36.298757 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:51:36.298757 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:36.299013 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:51:36.299049 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:51:36.299224 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:51:37.214299 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:51:37.214705 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a48e0d44-3f51-427a-9204-24e2a87f8f9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:51:37.214705 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0d29382d-ccc4-4065-9351-d448a9e7d199 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:51:37.214855 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:51:37.215051 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:51:36 up 43 min,  2 users,  load average: 3.79, 5.34, 4.79\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_d963dbf38a7f450c88af23dc0786e125': '2', 'io_workload': '1', 'num_proj_e2107e69e4f24f49ad24e398462243ac': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:51:37.289529 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:51:37.299945 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:51:37.299945 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.303044 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:51:37.311970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:51:37.317668 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:51:37.317668 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.325255 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.325255 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.325255 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:37.325451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.325451 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.325451 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:37.332806 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.348302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.348302 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.348302 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:37.348468 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.348468 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.348468 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:37.367449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.40.100,3260]
May 14 03:51:37.367449 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.40.100,3260] successful.
May 14 03:51:37.367449 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.378739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.391225 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.50.100,3260]
May 14 03:51:37.391225 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.50.100,3260] successful.
May 14 03:51:37.391225 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.393107 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.393107 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.393107 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.393107 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.393107 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:37.394023 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.394023 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.394023 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.394023 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.394023 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:37.395788 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:37.395970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:51:37.397905 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('7', '-', '-', 0) found on session 201 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:51:37.398071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:51:37.399864 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:51:37.400060 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:51:37.402380 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:51:37.416817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 201 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:51:37.418343 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:51:37.419048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.419048 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.419048 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.419048 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.419048 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:51:37.419220 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.419220 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:51:37.419220 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.419220 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:51:37.419220 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:51:37.419449 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:37.419545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:51:37.420056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('8', '-', '-', 0) found on session 202 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:51:37.420157 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:51:37.443091 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 202 and hctl ['8', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:51:37.902604 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:51:38.408725 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:51:38.409253 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.266s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:38.409253 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:38.444011 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 202 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:51:38.444185 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:51:38.835828 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:38.980717 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:39.276310 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Found WWN 33000000080ba18dc for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:51:39.276628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:51:39.276877 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000080ba18dc', 'path': '/dev/dm-0', 'multipath_id': '33000000080ba18dc'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:51:39.277030 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000080ba18dc', 'path': '/dev/dm-0', 'multipath_id': '33000000080ba18dc'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:51:39.782613 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1620839996',display_name='tempest-TestVolumeBootPatternV346-server-1620839996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1620839996',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8xTvcSkHLg8ULkiP9baePOdHBrLyB0OwdqT7tyFi+bU2JeXd3I4cg1FVsfcV247pY3KjI29k7yoCmFNuur1nOP3DtnU5CsciGlcNBFiuSJ31yJd4l49TkfJirEoTOfw==',key_name='tempest-keypair-2064462576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-hpgfcolj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=0d29382d-ccc4-4065-9351-d448a9e7d199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:51:39.783190 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:39.783418 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:39.783981 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d29382d-ccc4-4065-9351-d448a9e7d199 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:51:40.287393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] End _get_guest_xml xml=<domain type="qemu">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <uuid>0d29382d-ccc4-4065-9351-d448a9e7d199</uuid>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <name>instance-0000004d</name>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1620839996</nova:name>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:51:36</nova:creationTime>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:user uuid="1502fd1ebb564a38a0329ad56584a769">tempest-TestVolumeBootPatternV346-1499777380-project-member</nova:user>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:project uuid="d963dbf38a7f450c88af23dc0786e125">tempest-TestVolumeBootPatternV346-1499777380</nova:project>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         <nova:port uuid="5cd66f4e-4d29-40bc-afe3-13e56ee86fa3">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <system>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="serial">0d29382d-ccc4-4065-9351-d448a9e7d199</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="uuid">0d29382d-ccc4-4065-9351-d448a9e7d199</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </system>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <os>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </os>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <features>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </features>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   <devices>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/disk.config"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </disk>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <alias name="ua-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <serial>b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1</serial>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </disk>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:f8:f6:59"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <target dev="tap5cd66f4e-4d"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </interface>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/console.log" append="off"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </serial>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <video>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </video>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </rng>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:   </devices>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]: </domain>
May 14 03:51:40.287393 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:51:40.290608 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Preparing to wait for external event network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:51:40.290608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:40.290608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:40.290608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:40.292451 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1620839996',display_name='tempest-TestVolumeBootPatternV346-server-1620839996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1620839996',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8xTvcSkHLg8ULkiP9baePOdHBrLyB0OwdqT7tyFi+bU2JeXd3I4cg1FVsfcV247pY3KjI29k7yoCmFNuur1nOP3DtnU5CsciGlcNBFiuSJ31yJd4l49TkfJirEoTOfw==',key_name='tempest-keypair-2064462576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-hpgfcolj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=0d29382d-ccc4-4065-9351-d448a9e7d199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:51:40.292788 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:51:40.293410 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:51:40.295189 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:51:40.295535 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.295803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:40.296079 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:51:40.296709 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.296964 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8d81859-9b0d-54b2-9d4d-a2418625836a', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:40.297690 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.298476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:40.298724 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.300496 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.300681 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cd66f4e-4d, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:40.301106 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cd66f4e-4d, col_values=(('qos', UUID('23013d1b-1062-4d35-95ce-c621fe0c1907')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:40.301270 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cd66f4e-4d, col_values=(('external_ids', {'iface-id': '5cd66f4e-4d29-40bc-afe3-13e56ee86fa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:f6:59', 'vm-uuid': '0d29382d-ccc4-4065-9351-d448a9e7d199'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:51:40.302036 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.303406 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:51:40.378379 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.378650 np0000000741 nova-compute[97948]: INFO os_vif [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d')
May 14 03:51:40.381301 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:40.409293 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:40.409477 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:40.409684 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:40.409928 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.57 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:41.898239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:51:41.898239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:51:41.898239 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No VIF found with MAC fa:16:3e:f8:f6:59, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:51:41.900090 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Using config drive
May 14 03:51:41.934212 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:42.405357 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:42.534842 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Creating config drive at /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/disk.config
May 14 03:51:42.541187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjsjw1gib {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:51:42.599047 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjsjw1gib" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:51:43.015732 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:43.037488 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:43.141510 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:43.158718 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:43.159447 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:43.322841 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-01302641-c373-451b-a2af-aa0dd9311bbb req-92ad546a-7c96-4e1b-8b90-fcae7e60a6fd service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:43.322841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01302641-c373-451b-a2af-aa0dd9311bbb req-92ad546a-7c96-4e1b-8b90-fcae7e60a6fd service nova] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:43.322841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01302641-c373-451b-a2af-aa0dd9311bbb req-92ad546a-7c96-4e1b-8b90-fcae7e60a6fd service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:43.322841 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-01302641-c373-451b-a2af-aa0dd9311bbb req-92ad546a-7c96-4e1b-8b90-fcae7e60a6fd service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:43.322841 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-01302641-c373-451b-a2af-aa0dd9311bbb req-92ad546a-7c96-4e1b-8b90-fcae7e60a6fd service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Processing event network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:51:43.737167 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730703.7367418, 0d29382d-ccc4-4065-9351-d448a9e7d199 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:43.737308 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] VM Started (Lifecycle Event)
May 14 03:51:43.738843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:51:43.741126 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:51:43.743440 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance spawned successfully.
May 14 03:51:43.744621 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:51:43.983328 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:44.139017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:44.240545 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:44.243276 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:51:44.255728 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.259665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.259665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.259665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.259665 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.260223 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:51:44.748716 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:51:44.749021 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730704.7487946, 0d29382d-ccc4-4065-9351-d448a9e7d199 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:44.749185 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] VM Paused (Lifecycle Event)
May 14 03:51:44.775059 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Took 8.55 seconds to spawn the instance on the hypervisor.
May 14 03:51:44.775565 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:44.974985 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0011031749995709106 future=<Future at 0x79d0b0787170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:44.975145 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:51:44.975550 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730689.9737284, 6b67511f-42d0-418f-8315-3072389f618b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:44.975714 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] VM Stopped (Lifecycle Event)
May 14 03:51:45.252014 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:45.254041 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730705.2538197, 0d29382d-ccc4-4065-9351-d448a9e7d199 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:51:45.254199 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] VM Resumed (Lifecycle Event)
May 14 03:51:45.286526 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Took 15.59 seconds to build instance.
May 14 03:51:45.303139 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:45.380629 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:45.380809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:45.380959 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:45.381064 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:45.381190 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] No waiting events found dispatching network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:51:45.381335 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-1c2252af-1d4c-4c1d-a6e5-0c205d538190 req-fb2323d5-eee8-45a7-b4a4-9e000b668a7c service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received unexpected event network-vif-plugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 for instance with vm_state active and task_state None.
May 14 03:51:45.478336 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: 6b67511f-42d0-418f-8315-3072389f618b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:45.757171 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:51:45.762656 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:51:45.789057 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.095s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:46.270706 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:47.435855 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-changed-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:51:47.436269 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Refreshing instance network info cache due to event network-changed-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:51:47.436269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] Acquiring lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:51:47.436365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] Acquired lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:51:47.436470 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Refreshing network info cache for port 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:51:47.939246 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:48.229308 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:51:48.357648 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updated VIF entry in instance network info cache for port 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:51:48.357977 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating instance_info_cache with network_info: [{"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:51:48.860060 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-ff5ead51-921b-4774-b6d7-a0987ca9274e req-f348a3af-4e67-4fe4-8ada-e7193ead71fc service nova] Releasing lock "refresh_cache-0d29382d-ccc4-4065-9351-d448a9e7d199" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:51:48.984312 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:49.984842 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:51:50.306342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:50.489518 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:51:50.489937 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:51:50.490626 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:50.490687 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Triggering sync for uuid 0d29382d-ccc4-4065-9351-d448a9e7d199 {{(pid=97948) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 03:51:50.491287 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:50.491398 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:50.491741 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:51:50.491993 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:50.492115 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.79 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:51:50.492269 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:51:50.996614 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:50.999341 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:51.001343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:51:53.989745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:55.309377 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:51:59.005028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:00.311267 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:04.019582 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:05.313745 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:09.022708 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:10.255003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:10.255366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:10.316218 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:10.760220 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:11.765348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:12.875780 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:12.876194 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:12.876194 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attaching volume 7fde383d-db2b-4e8a-8746-02ea222f843a to /dev/vdb
May 14 03:52:12.922914 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:12.945319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:52:12.977379 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:13.025362 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:52:13.026056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:52:13.035319 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:52:13.036681 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fef8:f659'] 
May 14 03:52:13.036830 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:52:13.036965 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:52:13.037267 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:13.037584 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating existing volume attachment record: 10b43157-74f1-479f-a5bf-ecc9a0fd7dc1 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:52:13.587507 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:52:13.587836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:13.587989 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:13.588418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:13.588626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:52:13.602236 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:13.602821 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:13.603048 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:13.603443 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:13.603868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:13.604268 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:13.616801 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:13.616801 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:13.621588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:13.621588 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:13.637852 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a] added
May 14 03:52:13.637852 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:13.637852 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:13.637852 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:13.637852 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:13.637852 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:13.637852 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:13.640287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:13.642084 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0378(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:13.644727 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:13.645205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a] added
May 14 03:52:13.645205 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:13.645205 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:13.645205 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:13.645205 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:13.645205 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:13.645205 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:13.645425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:13.645635 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:13.645736 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:14.023684 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:14.645456 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:14.645983 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:14.659295 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:14.659295 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:14.664417 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:14.664417 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.672672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.676451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.687616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.687616 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.687616 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.687616 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.687616 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.687616 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:14.687825 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.687825 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.687825 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.687825 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.687825 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.687825 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:14.691525 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.691525 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.691525 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.691525 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.691525 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.691525 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:14.691679 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.691679 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.691679 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.691679 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.691679 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.691679 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:14.722600 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.50.100,3260]
May 14 03:52:14.722600 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.50.100,3260] successful.
May 14 03:52:14.722600 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.727188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.40.100,3260]
May 14 03:52:14.727188 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.40.100,3260] successful.
May 14 03:52:14.727188 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.733362 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.740293 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.746543 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.747044 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:14.747044 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:14.747754 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('12', '-', '-', 0) found on session 205 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:14.747851 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.754750 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-165ccc19-8f24-49e3-8d04-e7474f17b71b (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:14.754978 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:14.755164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:14.755164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:14.755996 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('13', '-', '-', 0) found on session 206 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:14.756092 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:14.763262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 205 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:14.763262 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:14.771297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 206 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:14.771297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:15.318117 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:15.604847 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:52:16.619207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found WWN 33000000029aa25ce for multipath device dm-4 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:52:16.619705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:16.619705 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000029aa25ce', 'path': '/dev/dm-4', 'multipath_id': '33000000029aa25ce'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:16.619705 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029aa25ce', 'path': '/dev/dm-4', 'multipath_id': '33000000029aa25ce'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:52:16.622584 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:17.125769 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to attach volume 7fde383d-db2b-4e8a-8746-02ea222f843a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:52:17.127249 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:   <alias name="ua-7fde383d-db2b-4e8a-8746-02ea222f843a"/>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:   <serial>7fde383d-db2b-4e8a-8746-02ea222f843a</serial>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]: </disk>
May 14 03:52:17.127249 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:52:18.771357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:18.771357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:18.771357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:18.771357 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:7d:0e:28, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:52:19.024931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:20.063247 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:20.308990 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-63f86aff-7145-4d9a-a5ce-e745674d7538 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:20.310003 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.246s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:20.319313 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:20.813709 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:21.818720 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:22.657547 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:22.657823 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:22.658080 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attaching volume bcb03416-1cbe-4f93-833b-e1b158eedde9 to /dev/vdc
May 14 03:52:22.695346 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:22.705708 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:52:22.726018 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:22.773731 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:52:22.773981 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:52:22.781670 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:52:22.782652 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fef8:f659'] 
May 14 03:52:22.782784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:52:22.782892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:52:22.783106 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:22.783372 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating existing volume attachment record: 657cd6e8-25b2-40c3-b1a5-ad0341fdd05c {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:52:23.358123 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a48e0d44-3f51-427a-9204-24e2a87f8f9a', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'serial': 'bcb03416-1cbe-4f93-833b-e1b158eedde9'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:52:23.361922 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:52:23.362377 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:23.362532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:23.463926 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.101s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:23.464189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:52:23.475990 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:23.476801 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:23.477290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:23.477515 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:23.478218 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:23.478455 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:23.490130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:23.490130 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:23.494450 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:23.494450 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9] added
May 14 03:52:23.503096 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:23.503096 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:23.503096 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:23.509015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9] added
May 14 03:52:23.509015 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:23.509015 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:23.509015 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:23.509015 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:23.509015 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:23.509015 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:23.509199 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:23.509309 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:23.509421 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:24.033358 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:24.503590 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:24.509742 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:24.515127 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:24.515127 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:24.521301 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:24.521301 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.527793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.533121 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.541925 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.546917 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.547173 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:24.582083 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.40.100,3260]
May 14 03:52:24.582083 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.40.100,3260] successful.
May 14 03:52:24.582083 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.586311 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.50.100,3260]
May 14 03:52:24.586311 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.50.100,3260] successful.
May 14 03:52:24.586311 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.593760 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.599941 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.610244 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('14', '-', '-', 0) found on session 208 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:24.610244 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.614699 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d5551ff-b5a9-4a76-83b8-5210fed05487 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:24.615036 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:24.615479 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:24.615479 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:24.616207 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('15', '-', '-', 0) found on session 209 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:24.616335 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:24.633205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 208 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:24.633205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:24.633205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 209 and hctl ['15', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:25.321321 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:25.628747 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 209 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:25.629114 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:26.493826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found WWN 3300000000a0b6c57 for multipath device dm-5 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:52:26.494095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:26.495089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== connect_volume: return (3132ms) {'type': 'block', 'scsi_wwn': '3300000000a0b6c57', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000000a0b6c57'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:26.495286 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a0b6c57', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000000a0b6c57'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:52:26.497472 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:52:26.497699 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:52:26.497888 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:52:26.517156 np0000000741 nova-compute[97948]: WARNING os_brick.encryptors.luks [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 03:52:26.517597 np0000000741 nova-compute[97948]: WARNING stevedore.named [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 03:52:26.517859 np0000000741 nova-compute[97948]: WARNING castellan.key_manager [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:52:26.518005 np0000000741 nova-compute[97948]: WARNING nova.keymgr.conf_key_mgr [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 03:52:26.518454 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x79d0b01a8b00>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'a48e0d44-3f51-427a-9204-24e2a87f8f9a', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'serial': 'bcb03416-1cbe-4f93-833b-e1b158eedde9'} {{(pid=97948) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 03:52:26.518576 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors.luks [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] formatting encrypted volume /dev/dm-5 {{(pid=97948) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 03:52:26.823352 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:28.748942 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:28.749323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:29.251063 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:52:29.284491 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:29.284948 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:29.784667 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:29.784667 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:29.808797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:29.808797 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:29.812284 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:52:29.812730 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Claim successful on node np0000000741
May 14 03:52:30.324619 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:30.461662 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 03:52:30.461662 np0000000741 nova-compute[97948]:   <usage type="volume">
May 14 03:52:30.461662 np0000000741 nova-compute[97948]:     <volume>bcb03416-1cbe-4f93-833b-e1b158eedde9</volume>
May 14 03:52:30.461662 np0000000741 nova-compute[97948]:   </usage>
May 14 03:52:30.461662 np0000000741 nova-compute[97948]: </secret>
May 14 03:52:30.461662 np0000000741 nova-compute[97948]:  {{(pid=97948) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 03:52:30.475691 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:30.783018 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:30.783359 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:30.978163 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to attach volume bcb03416-1cbe-4f93-833b-e1b158eedde9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:52:30.979556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <alias name="ua-bcb03416-1cbe-4f93-833b-e1b158eedde9"/>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <serial>bcb03416-1cbe-4f93-833b-e1b158eedde9</serial>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="ff454fbd-87b9-4f6d-a731-591d78a36db1"/>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]: </disk>
May 14 03:52:30.979556 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:52:31.012466 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:52:31.012680 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:52:31.515278 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:52:31.783096 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:31.783457 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:32.022655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.215s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:32.023096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:52:32.527970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:52:32.531664 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:52:32.531664 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:32.531664 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:32.592571 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1502fd1ebb564a38a0329ad56584a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963dbf38a7f450c88af23dc0786e125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:52:33.016225 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Successfully created port: 1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:52:33.029211 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:52:33.422058 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Successfully updated port: 1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:52:33.464697 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-changed-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:52:33.465679 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Refreshing instance network info cache due to event network-changed-1e9b88df-61ea-40d4-a7b9-15d586843fa1. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:52:33.465679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] Acquiring lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:52:33.465679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] Acquired lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:52:33.465679 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Refreshing network info cache for port 1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:52:33.532671 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:52:33.572232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:33.572372 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:33.572465 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:33.572549 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:33.572634 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:7d:0e:28, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:52:33.926999 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:52:33.968279 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:34.036572 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Booting with volume 49524e0e-284e-4fa6-b757-c17b5bec77da at /dev/vda
May 14 03:52:34.040850 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:52:34.080087 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:34.089597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:52:34.114507 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:34.165356 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:52:34.166740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:52:34.176483 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:52:34.177658 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fef8:f659'] 
May 14 03:52:34.177826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:52:34.178006 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:52:34.178261 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:34.178541 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating existing volume attachment record: a68abd6f-eb02-4f53-afc1-aea745113765 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:52:34.192569 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:52:34.694839 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e4853754-033c-4e73-9719-f0f4f7e5397b req-cee8f76c-a178-4b5f-8dfa-76a3edc9dcb1 service nova] Releasing lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:52:34.695475 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquired lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:52:34.695790 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:52:34.783284 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:34.783471 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:52:34.783731 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:35.117204 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3f6de0bd-edc6-43a3-8ca5-2e0858eca70c tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.459s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:35.259118 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:52:35.328189 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:35.435413 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:35.567844 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating instance_info_cache with network_info: [{"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:52:35.668792 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:35.669690 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:35.783319 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:36.069503 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Releasing lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:52:36.069809 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance network_info: |[{"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:52:36.173497 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:36.269520 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:52:36.270467 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:52:36.270713 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Creating image(s)
May 14 03:52:36.271021 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Did not create local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 03:52:36.271149 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Ensure instance console log exists: /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:52:36.271344 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:36.271505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:36.271645 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:36.272067 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Start _get_guest_xml network_info=[{"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '87d9206f-9af9-4d61-97f5-6ff0585e576e', 'attached_at': '', 'detached_at': '', 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'serial': '49524e0e-284e-4fa6-b757-c17b5bec77da'}, 'boot_index': 0, 'attachment_id': 'a68abd6f-eb02-4f53-afc1-aea745113765', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:52:36.274604 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:52:36.275480 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1285311276', uuid='87d9206f-9af9-4d61-97f5-6ff0585e576e'), owner=OwnerMeta(userid='1502fd1ebb564a38a0329ad56584a769', username='tempest-TestVolumeBootPatternV346-1499777380-project-member', projectid='d963dbf38a7f450c88af23dc0786e125', projectname='tempest-TestVolumeBootPatternV346-1499777380'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730756.275208) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:52:36.276675 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:52:36.276956 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:52:36.277934 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:52:36.278103 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:52:36.279006 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:52:36.279255 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:52:36.279386 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:52:36.279474 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:52:36.279578 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:52:36.279673 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:52:36.279767 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:52:36.279909 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:52:36.280000 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:52:36.280109 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:52:36.280207 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:52:36.280312 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:52:36.288623 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:36.288962 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:36.289085 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:36.289222 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:52:36.291176 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:52:36.291502 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:36.291685 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:36.292136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:36.292326 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:52:36.303350 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:36.303865 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:36.304019 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:36.304466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:36.304999 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:36.305441 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:36.315580 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:36.315580 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:36.320634 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:36.320634 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:36.328558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da] added
May 14 03:52:36.328558 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:36.328558 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:36.328558 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:36.328558 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:36.328558 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:36.328558 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:36.328793 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:36.328891 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:36.329245 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:36.331565 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da] added
May 14 03:52:36.331565 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:36.331565 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:36.331565 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:36.331565 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:36.331565 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:36.331565 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:36.331789 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:36.331953 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:36.332134 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:37.178147 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:37.314258 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:52:37.315926 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:37.330756 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:37.332706 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:37.342912 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:37.342912 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:37.348153 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:37.348153 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.354290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.359964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.368817 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.369208 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.375476 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.375735 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:37.424273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.40.100,3260]
May 14 03:52:37.424273 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.40.100,3260] successful.
May 14 03:52:37.424273 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.424733 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:37.425166 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:37.437175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.451097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.50.100,3260]
May 14 03:52:37.451097 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.50.100,3260] successful.
May 14 03:52:37.451097 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.456129 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.456349 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:37.456970 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:37.457179 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:37.458328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('11', '-', '-', 0) found on session 210 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:37.458464 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:37.465058 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:37.473740 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 210 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:37.474033 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.485495 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:37.485780 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:37.486196 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:37.486440 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:37.487798 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] HCTL ('16', '-', '-', 0) found on session 211 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:37.487954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:37.502779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Searching for a device in session 211 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:37.503052 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:37.518314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:37.518611 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:52:37.518736 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:52:37.522669 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:52:37.525032 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:52:37.525952 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:37.581422 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:37.582161 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13108MB free_disk=72.67097854614258GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:52:37.582161 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:37.582647 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:38.234955 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:38.235372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:38.235372 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attaching volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 to /dev/vdd
May 14 03:52:38.272593 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:38.284098 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:52:38.299732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:38.318777 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:52:38.346401 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:52:38.346653 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:52:38.355507 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:52:38.356903 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fef8:f659'] 
May 14 03:52:38.357071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:52:38.357213 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:52:38.357538 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:38.357866 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating existing volume attachment record: 72a7cf80-0564-42cb-aead-b6641afcd5f7 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:52:38.515093 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:38.631066 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:52:38.631171 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a48e0d44-3f51-427a-9204-24e2a87f8f9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:52:38.631276 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 0d29382d-ccc4-4065-9351-d448a9e7d199 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:52:38.631362 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 87d9206f-9af9-4d61-97f5-6ff0585e576e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:52:38.631512 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:52:38.631625 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:52:37 up 44 min,  2 users,  load average: 3.29, 4.97, 4.70\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_d963dbf38a7f450c88af23dc0786e125': '3', 'io_workload': '1', 'num_proj_e2107e69e4f24f49ad24e398462243ac': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:52:38.819257 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:52:38.819462 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:52:38.902482 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:52:38.902836 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:52:38.902955 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:39.053083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:39.321969 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:52:39.336715 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Found WWN 3300000001994cabd for multipath device dm-6 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:52:39.337019 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:39.337339 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000001994cabd', 'path': '/dev/dm-6', 'multipath_id': '3300000001994cabd'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:39.337453 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001994cabd', 'path': '/dev/dm-6', 'multipath_id': '3300000001994cabd'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:52:39.337906 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.435s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:39.338239 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:52:39.351345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:39.351969 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:52:39.352453 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:39.352620 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:39.353148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:52:39.353415 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:39.364080 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:39.364080 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:39.368768 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:52:39.368768 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:39.375835 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99] added
May 14 03:52:39.375835 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:39.375835 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:39.375835 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:39.375835 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:39.375835 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:39.375835 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:39.376045 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:39.376179 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:39.376349 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:39.379000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99] added
May 14 03:52:39.379000 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:52:39.379000 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:39.379000 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:39.379000 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:52:39.379000 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:52:39.379000 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:39.379161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:52:39.379283 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:52:39.379401 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:52:39.827824 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:52:39.828013 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.246s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:39.828427 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:39.842670 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1285311276',display_name='tempest-TestVolumeBootPatternV346-server-1285311276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1285311276',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOHxrGLRvII2gVw/zqOQMiuI7wEJT7x8rmppBtu6MRQd/ANIFVinhz/dHus9uLdkVNZRyZqF6bHbP/3HsubcjvU/dStRxpphiYgOTRg6kdCPJBaQmZpWzzcsTsHL+3tg==',key_name='tempest-keypair-1735191873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-b9qecdn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=87d9206f-9af9-4d61-97f5-6ff0585e576e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:52:39.842914 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:52:39.843389 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:52:39.844434 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'pci_devices' on Instance uuid 87d9206f-9af9-4d61-97f5-6ff0585e576e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:40.329512 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.347177 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] End _get_guest_xml xml=<domain type="qemu">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <uuid>87d9206f-9af9-4d61-97f5-6ff0585e576e</uuid>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <name>instance-0000004e</name>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1285311276</nova:name>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:52:36</nova:creationTime>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:image uuid="">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:user uuid="1502fd1ebb564a38a0329ad56584a769">tempest-TestVolumeBootPatternV346-1499777380-project-member</nova:user>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:project uuid="d963dbf38a7f450c88af23dc0786e125">tempest-TestVolumeBootPatternV346-1499777380</nova:project>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:root type="volume" uuid=""/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         <nova:port uuid="1e9b88df-61ea-40d4-a7b9-15d586843fa1">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <system>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="serial">87d9206f-9af9-4d61-97f5-6ff0585e576e</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="uuid">87d9206f-9af9-4d61-97f5-6ff0585e576e</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </system>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <os>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </os>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <features>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </features>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   <devices>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/disk.config"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </disk>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <alias name="ua-49524e0e-284e-4fa6-b757-c17b5bec77da"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-6"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <serial>49524e0e-284e-4fa6-b757-c17b5bec77da</serial>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </disk>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:1d:63:fa"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <target dev="tap1e9b88df-61"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </interface>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/console.log" append="off"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </serial>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <video>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </video>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </rng>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:   </devices>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]: </domain>
May 14 03:52:40.347177 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Preparing to wait for external event network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1285311276',display_name='tempest-TestVolumeBootPatternV346-server-1285311276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1285311276',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOHxrGLRvII2gVw/zqOQMiuI7wEJT7x8rmppBtu6MRQd/ANIFVinhz/dHus9uLdkVNZRyZqF6bHbP/3HsubcjvU/dStRxpphiYgOTRg6kdCPJBaQmZpWzzcsTsHL+3tg==',key_name='tempest-keypair-1735191873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-b9qecdn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=87d9206f-9af9-4d61-97f5-6ff0585e576e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:40.350440 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:52:40.351138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.351138 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b32f5a5d-560d-5178-b58f-c45116b761d9', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:40.351872 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.352489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:52:40.353004 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.354897 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.355057 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e9b88df-61, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:40.355363 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e9b88df-61, col_values=(('qos', UUID('28e413aa-7d78-4084-91ef-d907bb021749')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:40.355538 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e9b88df-61, col_values=(('external_ids', {'iface-id': '1e9b88df-61ea-40d4-a7b9-15d586843fa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:63:fa', 'vm-uuid': '87d9206f-9af9-4d61-97f5-6ff0585e576e'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:40.356291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.357332 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:52:40.361756 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:40.362393 np0000000741 nova-compute[97948]: INFO os_vif [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61')
May 14 03:52:40.376825 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:52:40.379786 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:40.388987 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:40.388987 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:52:40.394774 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:52:40.394774 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.401339 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.407327 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.417330 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.417701 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.423272 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.423550 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:40.460539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.50.100,3260]
May 14 03:52:40.460539 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.50.100,3260] successful.
May 14 03:52:40.460539 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.470437 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.471015 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.40.100,3260]
May 14 03:52:40.471015 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.40.100,3260] successful.
May 14 03:52:40.471015 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.484279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.488676 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.489110 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:40.489110 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:40.489526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:40.490299 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('17', '-', '-', 0) found on session 212 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:40.490393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 212 and hctl ['17', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:52:40.502223 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:40.502223 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:52:40.503306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('18', '-', '-', 0) found on session 213 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:52:40.503447 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:52:40.515275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 213 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:40.515275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:41.501458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 212 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:52:41.502028 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:52:41.828494 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:41.828674 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:41.828979 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:52:41.829240 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.95 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:52:41.876574 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:41.876741 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:41.876836 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] No VIF found with MAC fa:16:3e:1d:63:fa, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:52:41.877242 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Using config drive
May 14 03:52:42.367383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found WWN 3300000007f6e8c7f for multipath device dm-11 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:52:42.367593 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:52:42.367752 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== connect_volume: return (3465ms) {'type': 'block', 'scsi_wwn': '3300000007f6e8c7f', 'path': '/dev/dm-11', 'multipath_id': '3300000007f6e8c7f'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:52:42.367874 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f6e8c7f', 'path': '/dev/dm-11', 'multipath_id': '3300000007f6e8c7f'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:52:42.370249 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:42.381948 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:42.483272 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Creating config drive at /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/disk.config
May 14 03:52:42.487137 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcspw68k {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:42.541350 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcspw68k" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:42.873343 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to attach volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:52:42.875911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <target dev="vdd" bus="virtio"/>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]: </disk>
May 14 03:52:42.875911 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:52:42.904203 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:42.924908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:42.926400 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:43.025046 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:43.026170 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:43.062825 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1ce476cd-7199-4458-bd81-f1e7cc5ac358 req-9dddce2b-6ce4-4b52-b9f5-18418252d57f service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:52:43.063069 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ce476cd-7199-4458-bd81-f1e7cc5ac358 req-9dddce2b-6ce4-4b52-b9f5-18418252d57f service nova] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:43.063305 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ce476cd-7199-4458-bd81-f1e7cc5ac358 req-9dddce2b-6ce4-4b52-b9f5-18418252d57f service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:43.063491 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-1ce476cd-7199-4458-bd81-f1e7cc5ac358 req-9dddce2b-6ce4-4b52-b9f5-18418252d57f service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:43.064568 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-1ce476cd-7199-4458-bd81-f1e7cc5ac358 req-9dddce2b-6ce4-4b52-b9f5-18418252d57f service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Processing event network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:52:43.118594 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:43.690108 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730763.6897283, 87d9206f-9af9-4d61-97f5-6ff0585e576e => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:52:43.690544 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:52:43.690839 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] VM Started (Lifecycle Event)
May 14 03:52:43.692584 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:52:43.696308 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance spawned successfully.
May 14 03:52:43.696756 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:52:44.070602 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:44.193378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:52:44.195682 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:52:44.203687 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.203827 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.204183 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.204405 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.204731 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.205033 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:52:44.544173 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:44.544405 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:44.544525 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:44.544630 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdd, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:44.544748 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:44.544970 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:7d:0e:28, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:52:44.698453 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:52:44.699021 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730764.698511, 87d9206f-9af9-4d61-97f5-6ff0585e576e => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:52:44.699021 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] VM Paused (Lifecycle Event)
May 14 03:52:44.710697 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Took 8.44 seconds to spawn the instance on the hypervisor.
May 14 03:52:44.710909 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:52:45.125754 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:52:45.125923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:45.126092 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:45.126207 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:45.126364 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] No waiting events found dispatching network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:52:45.126518 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-e58938f9-785b-490a-9379-10f84704b47e req-e713f9a8-71cb-44eb-8730-afaa6a6ceecf service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received unexpected event network-vif-plugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 for instance with vm_state active and task_state None.
May 14 03:52:45.200944 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:52:45.203839 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730765.2036135, 87d9206f-9af9-4d61-97f5-6ff0585e576e => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:52:45.203934 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] VM Resumed (Lifecycle Event)
May 14 03:52:45.218945 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Took 15.46 seconds to build instance.
May 14 03:52:45.357670 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:45.706289 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:52:45.711208 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:52:45.722441 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.973s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:46.106397 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-9989cd0b-d5c4-4796-8fa2-3b8c9d3883b0 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.871s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:46.415110 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-changed-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:52:46.415268 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Refreshing instance network info cache due to event network-changed-1e9b88df-61ea-40d4-a7b9-15d586843fa1. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:52:46.415455 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] Acquiring lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:52:46.415582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] Acquired lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:52:46.415756 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Refreshing network info cache for port 1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:52:46.918510 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:47.212067 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:47.366609 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updated VIF entry in instance network info cache for port 1e9b88df-61ea-40d4-a7b9-15d586843fa1. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:52:47.366856 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating instance_info_cache with network_info: [{"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:52:47.868760 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-33a597cd-3b70-42d7-a3a1-8ea3bfbeeb8d req-fabc7415-906c-4105-af79-59658763668c service nova] Releasing lock "refresh_cache-87d9206f-9af9-4d61-97f5-6ff0585e576e" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:52:49.086080 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:49.332307 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:49.332500 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:49.834838 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:52:50.359403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:50.384794 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:50.384980 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:50.388533 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:52:50.388720 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Claim successful on node np0000000741
May 14 03:52:51.644545 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:52:51.644932 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:52:52.147105 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:52:52.653101 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.268s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:52.653573 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:52:53.158496 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:52:53.159395 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:52:53.159395 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:53.159395 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:53.225577 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27cad4e205374f8b8879c440af287684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2107e69e4f24f49ad24e398462243ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:52:53.645957 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Successfully created port: 6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:52:53.661012 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:52:54.065767 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Successfully updated port: 6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:52:54.088083 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:54.116471 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-changed-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:52:54.117911 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Refreshing instance network info cache due to event network-changed-6bf18843-a222-41bb-b135-8da288b8012b. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:52:54.117911 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] Acquiring lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:52:54.117911 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] Acquired lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:52:54.117911 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Refreshing network info cache for port 6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:52:54.163796 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:52:54.567535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:52:54.623396 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:54.676730 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:52:54.809672 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:52:55.173674 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:52:55.173674 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:52:55.173674 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Creating image(s)
May 14 03:52:55.173674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:55.173674 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:55.174091 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:55.174791 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:52:55.178433 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:52:55.179782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:55.283849 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:55.284565 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:55.285184 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:55.285830 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:52:55.288619 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:52:55.289153 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:55.313608 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f4b4d59b-f5e4-4aef-b336-2b65bb856929 req-847caaf0-e1a0-4336-a6ba-c8509975d5ff service nova] Releasing lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:52:55.314607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquired lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:52:55.314939 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:52:55.362409 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:55.380175 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:55.383661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:55.444223 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk 1073741824" returned: 0 in 0.063s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:55.447277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:55.447277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:55.543313 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.097s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:55.546654 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:52:55.546654 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:55.643995 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Cannot resize image /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Ensure instance console log exists: /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:55.645801 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:55.888784 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:52:56.014846 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:56.127680 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating instance_info_cache with network_info: [{"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:52:56.630348 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Releasing lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:52:56.630789 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance network_info: |[{"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:52:56.632862 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Start _get_guest_xml network_info=[{"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:52:56.642986 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:52:56.644654 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1468206622', uuid='7ffc3f7d-8e3d-423d-a189-8f408bed85a4'), owner=OwnerMeta(userid='27cad4e205374f8b8879c440af287684', username='tempest-VolumeMultiattachTests-1122220317-project-member', projectid='e2107e69e4f24f49ad24e398462243ac', projectname='tempest-VolumeMultiattachTests-1122220317'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730776.6442778) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:52:56.645981 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:52:56.646369 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:52:56.648197 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:52:56.648389 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:52:56.649326 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:52:56.649629 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:52:56.649960 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:52:56.650107 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:52:56.650292 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:52:56.650436 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:52:56.650670 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:52:56.650967 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:52:56.651080 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:52:56.651204 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:52:56.651319 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:52:56.651452 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:52:56.667799 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1468206622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1468206622',id=79,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-v708w0vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:52:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=7ffc3f7d-8e3d-423d-a189-8f408bed85a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:52:56.668010 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:52:56.669274 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:52:56.669274 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:52:57.171615 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] End _get_guest_xml xml=<domain type="qemu">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <uuid>7ffc3f7d-8e3d-423d-a189-8f408bed85a4</uuid>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <name>instance-0000004f</name>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumeMultiattachTests-server-1468206622</nova:name>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:52:56</nova:creationTime>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:user uuid="27cad4e205374f8b8879c440af287684">tempest-VolumeMultiattachTests-1122220317-project-member</nova:user>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:project uuid="e2107e69e4f24f49ad24e398462243ac">tempest-VolumeMultiattachTests-1122220317</nova:project>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         <nova:port uuid="6bf18843-a222-41bb-b135-8da288b8012b">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <system>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="serial">7ffc3f7d-8e3d-423d-a189-8f408bed85a4</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="uuid">7ffc3f7d-8e3d-423d-a189-8f408bed85a4</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </system>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <os>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </os>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <features>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </features>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   <devices>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </disk>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.config"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </disk>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:c8:51:45"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <target dev="tap6bf18843-a2"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </interface>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/console.log" append="off"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </serial>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <video>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </video>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </rng>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:   </devices>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]: </domain>
May 14 03:52:57.171615 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Preparing to wait for external event network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1468206622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1468206622',id=79,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-v708w0vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:52:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=7ffc3f7d-8e3d-423d-a189-8f408bed85a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:52:57.173853 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:52:57.174417 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.174875 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:57.175180 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:52:57.175922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.176116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f5fe7e7-84f8-5713-9fa9-d0cc27d674b9', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:57.177933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.177933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:52:57.177933 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.180931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.181101 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bf18843-a2, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:57.181416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bf18843-a2, col_values=(('qos', UUID('76f88348-86ab-4e78-b44b-01a9bb52460f')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:57.181585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bf18843-a2, col_values=(('external_ids', {'iface-id': '6bf18843-a222-41bb-b135-8da288b8012b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:51:45', 'vm-uuid': '7ffc3f7d-8e3d-423d-a189-8f408bed85a4'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:52:57.182631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.183381 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:52:57.187372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:57.188185 np0000000741 nova-compute[97948]: INFO os_vif [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2')
May 14 03:52:58.704721 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:58.705234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:52:58.705234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:c8:51:45, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:52:58.705474 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Using config drive
May 14 03:52:59.106652 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:59.210803 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:52:59.425017 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Creating config drive at /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.config
May 14 03:52:59.429655 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2dwrb_c5 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:52:59.488546 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2dwrb_c5" returned: 0 in 0.058s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:52:59.903931 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:59.930988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:52:59.933199 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:00.009666 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:00.011055 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:00.013464 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:00.079554 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2e84a7f5-bebd-4d0c-aa23-3abeba6f38c3 req-755d742b-43ae-4f30-9a59-aa1bf8feee95 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:00.079554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2e84a7f5-bebd-4d0c-aa23-3abeba6f38c3 req-755d742b-43ae-4f30-9a59-aa1bf8feee95 service nova] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:00.079554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2e84a7f5-bebd-4d0c-aa23-3abeba6f38c3 req-755d742b-43ae-4f30-9a59-aa1bf8feee95 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:00.079554 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2e84a7f5-bebd-4d0c-aa23-3abeba6f38c3 req-755d742b-43ae-4f30-9a59-aa1bf8feee95 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:00.079554 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2e84a7f5-bebd-4d0c-aa23-3abeba6f38c3 req-755d742b-43ae-4f30-9a59-aa1bf8feee95 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Processing event network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:53:00.627159 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:53:00.627706 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730780.6273196, 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:00.627842 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] VM Started (Lifecycle Event)
May 14 03:53:00.629699 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:53:00.632939 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance spawned successfully.
May 14 03:53:00.633398 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:53:01.130921 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:01.133676 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:53:01.140863 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.141040 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.141340 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.141608 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.141943 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.142243 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:01.638924 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:53:01.639818 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730781.639013, 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:01.639818 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] VM Paused (Lifecycle Event)
May 14 03:53:01.649557 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Took 6.48 seconds to spawn the instance on the hypervisor.
May 14 03:53:01.649771 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:02.145572 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:02.146523 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:02.147896 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:02.147896 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:02.148035 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:02.148201 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] No waiting events found dispatching network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:02.148386 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-c19aca2f-8a49-4fe3-a385-8627bb4a23dd req-0b2c5217-352f-4ffd-b7a9-ff0f52887fd5 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received unexpected event network-vif-plugged-6bf18843-a222-41bb-b135-8da288b8012b for instance with vm_state active and task_state None.
May 14 03:53:02.150565 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730782.1497273, 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:02.150565 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] VM Resumed (Lifecycle Event)
May 14 03:53:02.165208 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Took 11.83 seconds to build instance.
May 14 03:53:02.185209 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:02.652228 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:02.654602 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:53:02.666545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1cd9c8ba-8b89-4b56-bf13-a0b65b9d2592 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.334s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:03.546402 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:03.546402 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing instance network info cache due to event network-changed-f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:53:03.546402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] Acquiring lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:53:03.546402 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] Acquired lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:53:03.546402 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Refreshing network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:53:04.048513 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:04.108033 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:04.374711 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:04.483578 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updated VIF entry in instance network info cache for port f11bdd3e-60c3-4754-80a8-7bd20f9fe014. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:53:04.483835 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating instance_info_cache with network_info: [{"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:04.985605 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-de940004-edb5-405b-a75a-30dacae8abe3 req-229c66cf-f4a1-4a28-ad05-84a9983c9490 service nova] Releasing lock "refresh_cache-a48e0d44-3f51-427a-9204-24e2a87f8f9a" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:53:05.598694 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-changed-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:05.598984 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Refreshing instance network info cache due to event network-changed-6bf18843-a222-41bb-b135-8da288b8012b. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:53:05.599123 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] Acquiring lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:53:05.599211 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] Acquired lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:53:05.599311 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Refreshing network info cache for port 6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:53:06.101103 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:06.357039 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:06.500793 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updated VIF entry in instance network info cache for port 6bf18843-a222-41bb-b135-8da288b8012b. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:53:06.501063 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating instance_info_cache with network_info: [{"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:07.003039 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-414cb74b-593a-4add-a4ef-a6c5d565b3f7 req-ceb521ff-d0be-4b3a-9e18-54a14879738a service nova] Releasing lock "refresh_cache-7ffc3f7d-8e3d-423d-a189-8f408bed85a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:53:07.200747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:09.110316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:12.213595 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:14.112492 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:17.227825 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:19.115503 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:22.231124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:23.183312 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:23.183465 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:23.183705 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:23.183908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:23.184053 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:23.185989 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Terminating instance
May 14 03:53:23.688870 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:53:23.709281 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:23.712968 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:23.737630 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:23.881657 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:23.881811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:23.881989 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:23.882029 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:23.883054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] No waiting events found dispatching network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:23.883054 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-aa402286-c9ce-43be-9f25-6ae45c6f6647 req-ab8868ef-5709-40a5-ba0d-8e2b889dc3e4 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:23.996012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.005087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.026621 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99966946099994 future=<Future at 0x79d0907a7ec0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:24.027696 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99855319199969 future=<Future at 0x79d0907a7ec0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:24.027987 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998190522999721 future=<Future at 0x79d0907a7ec0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:24.029946 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Instance destroyed successfully.
May 14 03:53:24.030462 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'resources' on Instance uuid 87d9206f-9af9-4d61-97f5-6ff0585e576e {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:24.117437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.533416 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1285311276',display_name='tempest-TestVolumeBootPatternV346-server-1285311276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1285311276',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOHxrGLRvII2gVw/zqOQMiuI7wEJT7x8rmppBtu6MRQd/ANIFVinhz/dHus9uLdkVNZRyZqF6bHbP/3HsubcjvU/dStRxpphiYgOTRg6kdCPJBaQmZpWzzcsTsHL+3tg==',key_name='tempest-keypair-1735191873',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:52:44Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-b9qecdn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=87d9206f-9af9-4d61-97f5-6ff0585e576e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:53:24.533663 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "address": "fa:16:3e:1d:63:fa", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9b88df-61", "ovs_interfaceid": "1e9b88df-61ea-40d4-a7b9-15d586843fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:24.534114 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:24.534339 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:53:24.535565 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.536558 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e9b88df-61, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:24.538318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.538318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:24.539584 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.539584 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28e413aa-7d78-4084-91ef-d907bb021749) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:24.540468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.540468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:24.540692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:24.542557 np0000000741 nova-compute[97948]: INFO os_vif [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:63:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e9b88df-61ea-40d4-a7b9-15d586843fa1,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9b88df-61')
May 14 03:53:24.543957 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:24.544228 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:24.544365 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:24.605314 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.061s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:24.605770 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49524e0e-284e-4fa6-b757-c17b5bec77da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:24.605956 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:24.633868 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:24.634237 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '213')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:24.634237 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', '210')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:24.635222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da', '211')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:24.636089 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b01ee0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'): ({'sdk'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:24.636286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Removing multipathed devices sdk, sdf {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:24.636472 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flush multipath device 3300000001994cabd {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:24.685841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:24.729930 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:24.761935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if SCSI volumes sdk, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:24.762113 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] SCSI volumes sdk, sdf have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:24.763350 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if device paths {'sdk', 'sdf'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:24.773730 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Device paths {'sdk', 'sdf'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:24.773921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:24.784892 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.818498 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.40.100,3260]
May 14 03:53:24.818498 np0000000741 nova-compute[97948]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.40.100,3260] successful.
May 14 03:53:24.818498 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.836660 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.846354 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.878685 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.50.100,3260]
May 14 03:53:24.878685 np0000000741 nova-compute[97948]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-49524e0e-284e-4fa6-b757-c17b5bec77da, portal: 192.168.50.100,3260] successful.
May 14 03:53:24.878685 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.896338 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:24.896557 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:24.896736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== disconnect_volume: return (352ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:24.896892 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:24.897169 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Deleting instance files /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e_del
May 14 03:53:24.897623 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Deletion of /opt/stack/data/nova/instances/87d9206f-9af9-4d61-97f5-6ff0585e576e_del complete
May 14 03:53:25.403301 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Took 1.71 seconds to destroy the instance on the hypervisor.
May 14 03:53:25.403774 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:53:25.403956 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:53:25.404064 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:53:25.404289 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:25.458144 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:25.819981 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61185073-a181-4a93-85f2-c73d38cf2b56 req-eb49bfc3-c755-4974-827c-bc4add139b57 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-deleted-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:25.820249 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-61185073-a181-4a93-85f2-c73d38cf2b56 req-eb49bfc3-c755-4974-827c-bc4add139b57 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Neutron deleted interface 1e9b88df-61ea-40d4-a7b9-15d586843fa1; detaching it from the instance and deleting it from the info cache
May 14 03:53:25.820332 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-61185073-a181-4a93-85f2-c73d38cf2b56 req-eb49bfc3-c755-4974-827c-bc4add139b57 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:25.947627 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:25.947857 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] Acquiring lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:25.947934 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:25.948237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:25.948363 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] No waiting events found dispatching network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:25.948470 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-d4b98137-c3d5-4c78-982b-b4923b41a91e req-a9116a65-2628-4325-9123-16140a4e8a3a service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Received event network-vif-unplugged-1e9b88df-61ea-40d4-a7b9-15d586843fa1 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:26.271552 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:26.325099 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-61185073-a181-4a93-85f2-c73d38cf2b56 req-eb49bfc3-c755-4974-827c-bc4add139b57 service nova] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Detach interface failed, port_id=1e9b88df-61ea-40d4-a7b9-15d586843fa1, reason: Instance 87d9206f-9af9-4d61-97f5-6ff0585e576e could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:53:26.773449 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Took 1.37 seconds to deallocate network for instance.
May 14 03:53:26.917362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:27.320757 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:53:27.827478 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:27.827478 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:28.088331 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:28.088669 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:28.590909 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:28.708280 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:28.708505 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:29.098316 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.271s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:29.119001 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:29.142528 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Deleted allocations for instance 87d9206f-9af9-4d61-97f5-6ff0585e576e
May 14 03:53:29.210142 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:53:29.539824 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:29.756185 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:29.756394 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:29.759473 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:53:29.759596 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Claim successful on node np0000000741
May 14 03:53:30.151234 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-5b03ef7d-0d95-41dd-8748-0bac3a965c13 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "87d9206f-9af9-4d61-97f5-6ff0585e576e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.968s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:30.205718 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:30.205874 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:30.708709 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:30.783383 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:30.783742 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:31.017592 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:31.017784 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:31.520281 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:31.714259 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:32.027526 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.271s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:32.027943 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:53:32.533504 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:53:32.534059 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:53:32.534354 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:32.534742 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:32.602234 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2661ee6fd54baa9ce229bf9dfb845e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a000d5b9f598473f96f349a002a80625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:53:32.776196 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:32.776418 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:32.776622 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Attaching volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 to /dev/vdb
May 14 03:53:32.783129 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:32.783446 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:32.814804 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:32.826933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:53:32.845927 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:32.886968 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:53:32.887215 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:53:32.894597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:53:32.895570 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fef8:f659', 'fe80::fc16:3eff:fec8:5145'] 
May 14 03:53:32.895684 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:53:32.895796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:53:32.896005 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:32.896256 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating existing volume attachment record: e1dd233b-9edb-4973-8957-97ede3eb03c6 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:53:32.994505 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Successfully created port: 2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:53:33.036559 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:53:33.405005 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Successfully updated port: 2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:53:33.449668 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:53:33.450111 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:33.450307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:33.450857 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:33.451148 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:53:33.463054 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:33.463758 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:33.464175 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:33.464364 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:53:33.464763 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:33.464933 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:53:33.480935 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:53:33.480935 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.startup = automatic
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.scan = manual
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:53:33.483457 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:53:33.483457 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:33.486073 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-changed-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:33.486073 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Refreshing instance network info cache due to event network-changed-2aa207c3-60a2-4541-b1bd-4b20276a7e2e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:53:33.486073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] Acquiring lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:53:33.486073 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] Acquired lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:53:33.486073 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Refreshing network info cache for port 2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:53:33.495489 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:33.500454 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.512187 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.512547 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:33.512922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:33.512922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:53:33.513563 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('18', '0', '0', 0) found on session 213 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:53:33.513719 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.518828 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:33.519073 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:33.519294 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:33.519389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:53:33.520268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('17', '0', '0', 0) found on session 212 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:53:33.520512 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:53:33.524945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 213 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:53:33.525133 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:53:33.528883 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 212 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:53:33.529027 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:53:33.783108 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:33.783525 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:33.907120 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:53:33.980679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:33.980925 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:33.981182 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:33.981355 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:33.981510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:33.984658 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Terminating instance
May 14 03:53:33.988285 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:34.041842 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:53:34.048458 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:53:34.122097 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.185228 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:34.464961 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 03:53:34.488009 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:53:34.503747 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.520368 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.540668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.546115 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Booting with volume 40c4a153-f078-4ee6-b422-eb11912029c7 at /dev/vdb
May 14 03:53:34.590690 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:34.601933 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:53:34.615405 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.619987 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:34.621582 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:34.667895 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:34.668171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:34.668412 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:34.668827 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:34.668951 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] No waiting events found dispatching network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:34.669086 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-9d77aa9f-1452-41d3-80fc-fa122f3ac774 req-6f5da831-9d78-4a11-907b-a8aa6f8c4b73 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:34.671997 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:53:34.672277 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:53:34.680318 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:53:34.681272 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:fe5f:c26b', 'fe80::b8bd:a6ff:febe:b05e', 'fe80::fc16:3eff:fe7d:e28', 'fe80::7807:b4ff:fe9e:6e63', 'fe80::fc16:3eff:fec8:5145'] 
May 14 03:53:34.681409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:53:34.681511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:53:34.681734 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:34.681910 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updating existing volume attachment record: 14044cac-eb67-4e4d-8724-3d56e11ea677 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:53:34.687138 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-70d72bd2-26b5-4aa0-9d04-a5f2e8b7c8ab req-a5519263-835d-4e96-b0a2-922d56a1a801 service nova] Releasing lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:53:34.687649 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquired lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:53:34.687818 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:53:34.816851 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.99971471400022 future=<Future at 0x79d0b0178e90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:34.819496 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Instance destroyed successfully.
May 14 03:53:34.819915 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'resources' on Instance uuid 0d29382d-ccc4-4065-9351-d448a9e7d199 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:35.258481 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:53:35.322553 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:51:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1620839996',display_name='tempest-TestVolumeBootPatternV346-server-1620839996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1620839996',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr8xTvcSkHLg8ULkiP9baePOdHBrLyB0OwdqT7tyFi+bU2JeXd3I4cg1FVsfcV247pY3KjI29k7yoCmFNuur1nOP3DtnU5CsciGlcNBFiuSJ31yJd4l49TkfJirEoTOfw==',key_name='tempest-keypair-2064462576',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:51:44Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-hpgfcolj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=0d29382d-ccc4-4065-9351-d448a9e7d199,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:53:35.322794 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "address": "fa:16:3e:f8:f6:59", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cd66f4e-4d", "ovs_interfaceid": "5cd66f4e-4d29-40bc-afe3-13e56ee86fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:35.323338 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:35.323556 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:53:35.325000 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:35.325285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cd66f4e-4d, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:35.332621 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:35.333721 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:35.334491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:35.334614 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23013d1b-1062-4d35-95ce-c621fe0c1907) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:35.335125 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:35.335713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:35.335825 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:35.337504 np0000000741 nova-compute[97948]: INFO os_vif [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f6:59,bridge_name='br-int',has_traffic_filtering=True,id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cd66f4e-4d')
May 14 03:53:35.338962 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:35.339287 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:35.339403 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:35.392326 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:35.480983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found WWN 3300000007f6e8c7f for multipath device dm-11 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:53:35.481297 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:35.481485 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== connect_volume: return (2030ms) {'type': 'block', 'scsi_wwn': '3300000007f6e8c7f', 'path': '/dev/dm-11', 'multipath_id': '3300000007f6e8c7f'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:35.481612 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f6e8c7f', 'path': '/dev/dm-11', 'multipath_id': '3300000007f6e8c7f'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:53:35.482129 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:35.482527 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:35.482714 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:35.485239 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:35.511341 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:35.511736 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:35.511736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '213')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:35.512142 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '201')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:35.513165 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1', '202')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:35.514249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8147a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:35.514444 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:35.514672 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flush multipath device 33000000080ba18dc {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:35.521844 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updating instance_info_cache with network_info: [{"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:35.569613 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:35.621243 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:35.658101 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:35.658340 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:35.659983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:35.670653 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:35.670896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:35.683395 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.716775 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.40.100,3260]
May 14 03:53:35.716775 np0000000741 nova-compute[97948]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.40.100,3260] successful.
May 14 03:53:35.716775 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.736039 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.746569 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.777983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.50.100,3260]
May 14 03:53:35.777983 np0000000741 nova-compute[97948]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-b73dc3f0-b5e2-4c4a-b63a-0be7cf14edf1, portal: 192.168.50.100,3260] successful.
May 14 03:53:35.777983 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.795516 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:35.795738 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:35.795841 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== disconnect_volume: return (456ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:35.795944 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:35.796210 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Deleting instance files /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199_del
May 14 03:53:35.796698 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Deletion of /opt/stack/data/nova/instances/0d29382d-ccc4-4065-9351-d448a9e7d199_del complete
May 14 03:53:35.988498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Attempting to attach volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:53:35.990171 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:35.990171 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:53:36.024916 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Releasing lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:53:36.025256 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance network_info: |[{"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:53:36.302488 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Took 1.81 seconds to destroy the instance on the hypervisor.
May 14 03:53:36.302934 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:53:36.303241 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:53:36.303375 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:53:36.303577 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:36.362157 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:36.720780 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:36.720965 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] Acquiring lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:36.721150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:36.721291 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:36.721452 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] No waiting events found dispatching network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:36.721833 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-705c25c0-39be-455d-8993-0edd168c89af req-57daa5bb-100b-4b69-9d64-72df9af1c909 service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-unplugged-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:36.769670 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:53:36.770726 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:53:36.770918 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Creating image(s)
May 14 03:53:36.771346 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:36.771521 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:36.773930 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-156f6770-2093-41c3-a3f7-8ce725bdc0fc req-db575a7f-da1c-4be4-96a2-ace8250e03ba service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Received event network-vif-deleted-5cd66f4e-4d29-40bc-afe3-13e56ee86fa3 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:36.774732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:36.774952 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-156f6770-2093-41c3-a3f7-8ce725bdc0fc req-db575a7f-da1c-4be4-96a2-ace8250e03ba service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Neutron deleted interface 5cd66f4e-4d29-40bc-afe3-13e56ee86fa3; detaching it from the instance and deleting it from the info cache
May 14 03:53:36.775468 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-156f6770-2093-41c3-a3f7-8ce725bdc0fc req-db575a7f-da1c-4be4-96a2-ace8250e03ba service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:36.775887 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:53:36.779317 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:53:36.780583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:36.793060 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:36.793347 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:53:36.793957 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:36.871440 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.091s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:36.871848 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:36.872297 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:36.872724 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:53:36.875279 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:53:36.875696 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:36.965858 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.090s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:36.966343 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:37.027197 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk 1073741824" returned: 0 in 0.060s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:37.027677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:37.028105 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:37.124062 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.096s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:37.124499 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:53:37.124773 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:37.203748 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:37.214365 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:37.214787 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Cannot resize image /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:53:37.215198 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:53:37.215417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Ensure instance console log exists: /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:53:37.215844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:37.216093 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:37.216281 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:37.218234 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Start _get_guest_xml network_info=[{"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a5866afe-e285-4ea3-9f02-19530c3290a4', 'attached_at': '', 'detached_at': '', 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'serial': '40c4a153-f078-4ee6-b422-eb11912029c7'}, 'boot_index': -1, 'attachment_id': '14044cac-eb67-4e4d-8724-3d56e11ea677', 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:53:37.222427 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:53:37.223688 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-instance-673818495', uuid='a5866afe-e285-4ea3-9f02-19530c3290a4'), owner=OwnerMeta(userid='6a2661ee6fd54baa9ce229bf9dfb845e', username='tempest-VolumesBackupsTest-728151775-project-member', projectid='a000d5b9f598473f96f349a002a80625', projectname='tempest-VolumesBackupsTest-728151775'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730817.2233398) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:53:37.224910 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:53:37.225250 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:53:37.226266 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:53:37.226460 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:53:37.227369 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:53:37.227740 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:53:37.227904 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:53:37.228041 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:53:37.228223 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:53:37.228352 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:53:37.228492 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:53:37.228714 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:53:37.228867 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:53:37.229036 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:53:37.229195 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:53:37.229363 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:53:37.240060 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:53:37.240458 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:37.240650 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:37.241102 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:37.241290 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:53:37.252389 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:37.253364 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:37.253935 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:37.254189 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:53:37.254842 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:37.255057 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:53:37.264790 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:53:37.264790 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:37.270949 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:53:37.270949 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:37.277302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7] added
May 14 03:53:37.277302 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:53:37.277302 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:53:37.277302 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:53:37.277302 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:53:37.277302 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:53:37.277302 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:37.277609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:53:37.277795 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:53:37.278004 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:53:37.281895 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-156f6770-2093-41c3-a3f7-8ce725bdc0fc req-db575a7f-da1c-4be4-96a2-ace8250e03ba service nova] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Detach interface failed, port_id=5cd66f4e-4d29-40bc-afe3-13e56ee86fa3, reason: Instance 0d29382d-ccc4-4065-9351-d448a9e7d199 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:53:37.283071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7] added
May 14 03:53:37.283071 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:53:37.283071 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:53:37.283071 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:53:37.283071 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:53:37.283071 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:53:37.283071 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:37.283390 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:53:37.283390 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:53:37.283486 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:53:37.643127 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:37.643313 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:37.643396 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:37.643552 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:c8:51:45, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:53:37.707038 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Took 1.40 seconds to deallocate network for instance.
May 14 03:53:37.783533 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:38.250054 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Took 0.54 seconds to detach 1 volumes for instance.
May 14 03:53:38.278435 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:53:38.284153 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:53:38.287510 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:38.287706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:38.287838 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:38.288035 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:53:38.290826 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:53:38.290826 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:53:38.296848 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:53:38.296848 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.303608 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.310041 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.319963 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.320402 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.326917 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.327178 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:38.362067 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.40.100,3260]
May 14 03:53:38.362067 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.40.100,3260] successful.
May 14 03:53:38.362067 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.366716 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.50.100,3260]
May 14 03:53:38.366716 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.50.100,3260] successful.
May 14 03:53:38.366716 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.373697 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.378687 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.390302 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.390729 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:38.390729 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:38.391156 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:53:38.391779 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] HCTL ('7', '-', '-', 0) found on session 217 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:53:38.391886 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.396919 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:38.397252 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:38.397463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:38.397463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:53:38.398379 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] HCTL ('8', '-', '-', 0) found on session 218 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:53:38.398476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:53:38.404476 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Searching for a device in session 217 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:53:38.405122 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:53:38.412461 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:53:38.756832 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:38.757028 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:39.000773 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:39.000984 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:39.026768 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0004611680001289642 future=<Future at 0x79d0907a7ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:39.027171 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Emitting event <LifecycleEvent: 1778730804.0260987, 87d9206f-9af9-4d61-97f5-6ff0585e576e => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:39.027316 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:39.027494 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] VM Stopped (Lifecycle Event)
May 14 03:53:39.028419 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=10.787979694000114 future=<Future at 0x79d0b0178e90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:39.028510 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=10.787871604999964 future=<Future at 0x79d0b0178e90 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:39.141924 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:39.200233 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a8a04e2b-8ee3-46fd-b2e1-68f40bf328e6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.424s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:39.313708 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:53:39.315274 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:39.413827 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:53:39.414071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:53:39.420355 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:39.420929 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:39.504334 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:39.513775 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:39.514232 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:53:39.519177 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:39.533067 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 87d9206f-9af9-4d61-97f5-6ff0585e576e] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:39.623237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:39.623706 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:39.708530 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:39.708911 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:53:39.709029 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:53:39.709139 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] skipping disk /dev/dm-11 (vdd) as it is a volume {{(pid=97948) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 03:53:39.712854 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:53:39.713864 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:39.759040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:39.759435 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13064MB free_disk=72.62742233276367GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:53:39.759661 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:40.012323 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.255s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:40.014564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.255s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:40.070573 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Deleted allocations for instance 0d29382d-ccc4-4065-9351-d448a9e7d199
May 14 03:53:40.271072 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Found WWN 330000000249a3ca4 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:53:40.271558 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:40.271808 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000249a3ca4', 'path': '/dev/dm-0', 'multipath_id': '330000000249a3ca4'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:40.272021 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000249a3ca4', 'path': '/dev/dm-0', 'multipath_id': '330000000249a3ca4'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:53:40.342504 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:40.777751 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-673818495',display_name='tempest-instance-673818495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-instance-673818495',id=80,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpCRNomXuU4T+FODEpxJcwrMJJh6oJXgemqDrtYKrz74nevkQi6dddp5Hw1lmVNvkbtSKl0HmjhRz90+avNKTo7YxcMk4C5eHtbFnGaq0+DnhwlOODKCA06ENqFP1L4Q==',key_name='tempest-keypair-2063575954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a000d5b9f598473f96f349a002a80625',ramdisk_id='',reservation_id='r-abhs6q0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-728151775',owner_user_name='tempest-VolumesBackupsTest-728151775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a2661ee6fd54baa9ce229bf9dfb845e',uuid=a5866afe-e285-4ea3-9f02-19530c3290a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:53:40.777959 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converting VIF {"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:40.778693 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:40.779441 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lazy-loading 'pci_devices' on Instance uuid a5866afe-e285-4ea3-9f02-19530c3290a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:40.840987 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:40.841203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:41.063865 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:53:41.063996 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a48e0d44-3f51-427a-9204-24e2a87f8f9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:53:41.064103 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:53:41.064203 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance a5866afe-e285-4ea3-9f02-19530c3290a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:53:41.064392 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:53:41.064525 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:53:39 up 45 min,  2 users,  load average: 2.42, 4.38, 4.52\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_d963dbf38a7f450c88af23dc0786e125': '1', 'io_workload': '1', 'num_proj_e2107e69e4f24f49ad24e398462243ac': '2', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_a000d5b9f598473f96f349a002a80625': '1'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:53:41.079618 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-3afb8992-f2c7-4ea3-bc4d-76c78e294f6f tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "0d29382d-ccc4-4065-9351-d448a9e7d199" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.098s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:41.270305 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:41.270515 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:41.282737 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] End _get_guest_xml xml=<domain type="qemu">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <uuid>a5866afe-e285-4ea3-9f02-19530c3290a4</uuid>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <name>instance-00000050</name>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:name>tempest-instance-673818495</nova:name>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:53:37</nova:creationTime>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:user uuid="6a2661ee6fd54baa9ce229bf9dfb845e">tempest-VolumesBackupsTest-728151775-project-member</nova:user>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:project uuid="a000d5b9f598473f96f349a002a80625">tempest-VolumesBackupsTest-728151775</nova:project>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         <nova:port uuid="2aa207c3-60a2-4541-b1bd-4b20276a7e2e">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <system>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="serial">a5866afe-e285-4ea3-9f02-19530c3290a4</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="uuid">a5866afe-e285-4ea3-9f02-19530c3290a4</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </system>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <os>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </os>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <features>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </features>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   <devices>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </disk>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.config"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </disk>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <disk type="block" device="disk">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <alias name="ua-40c4a153-f078-4ee6-b422-eb11912029c7"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <source dev="/dev/dm-0"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <target dev="vdb" bus="virtio"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <serial>40c4a153-f078-4ee6-b422-eb11912029c7</serial>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </disk>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:0d:dc:31"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <target dev="tap2aa207c3-60"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </interface>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/console.log" append="off"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </serial>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <video>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </video>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </rng>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:   </devices>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]: </domain>
May 14 03:53:41.282737 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Preparing to wait for external event network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-673818495',display_name='tempest-instance-673818495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-instance-673818495',id=80,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpCRNomXuU4T+FODEpxJcwrMJJh6oJXgemqDrtYKrz74nevkQi6dddp5Hw1lmVNvkbtSKl0HmjhRz90+avNKTo7YxcMk4C5eHtbFnGaq0+DnhwlOODKCA06ENqFP1L4Q==',key_name='tempest-keypair-2063575954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a000d5b9f598473f96f349a002a80625',ramdisk_id='',reservation_id='r-abhs6q0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-728151775',owner_user_name='tempest-VolumesBackupsTest-728151775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a2661ee6fd54baa9ce229bf9dfb845e',uuid=a5866afe-e285-4ea3-9f02-19530c3290a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:53:41.284714 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converting VIF {"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:41.285142 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:41.285408 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:53:41.285895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.286164 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:41.286416 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:53:41.287285 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.287426 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdaa25c7-625e-52e6-8992-c365dd9d11c5', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:41.288362 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.288996 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:41.289087 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.290859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.291005 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aa207c3-60, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:41.291307 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2aa207c3-60, col_values=(('qos', UUID('bac362d0-f0f7-4ed2-96da-71b4779d7420')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:41.291458 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2aa207c3-60, col_values=(('external_ids', {'iface-id': '2aa207c3-60a2-4541-b1bd-4b20276a7e2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:dc:31', 'vm-uuid': 'a5866afe-e285-4ea3-9f02-19530c3290a4'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:41.292175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.293257 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:41.297470 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:41.298278 np0000000741 nova-compute[97948]: INFO os_vif [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60')
May 14 03:53:41.343694 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Detaching volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:53:41.384687 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Attempting to driver detach volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 from mountpoint /dev/vdb
May 14 03:53:41.390009 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:41.391126 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:41.391257 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Attempting to detach device vdb from instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:53:41.391511 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:41.391511 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:41.398033 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 from the persistent domain config.
May 14 03:53:41.398344 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] (1/8): Attempting to detach device vdb with device alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 from instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:53:41.398685 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:41.398685 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:41.772891 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:41.853233 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730821.852881, 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 => ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:53:41.854192 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 for instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:53:41.856773 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 from the live domain config.
May 14 03:53:42.278955 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:53:42.279108 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.265s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:42.279466 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:42.386657 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Detected multiple connections on this host for volume: e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, skipping target disconnect.
May 14 03:53:42.815495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:42.815622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:42.815738 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:53:42.815838 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] No VIF found with MAC fa:16:3e:0d:dc:31, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:53:42.816276 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Using config drive
May 14 03:53:42.931392 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:43.279167 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:43.279431 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:43.279624 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:53:43.279933 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:53:43.321082 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:43.437262 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Creating config drive at /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.config
May 14 03:53:43.442589 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpop6gipd4 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:53:43.499106 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpop6gipd4" returned: 0 in 0.056s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:53:43.891819 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:43.911552 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:43.914243 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:43.939095 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-a56c1de9-1909-4fc1-968f-ed8e21e56fab tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.098s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:43.992771 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.037921 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2c9b145a-ba6b-4a40-abf7-fc513bda3ed7 req-3aba3ef8-2aa7-45ba-8392-3ba99aab8065 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:44.038171 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c9b145a-ba6b-4a40-abf7-fc513bda3ed7 req-3aba3ef8-2aa7-45ba-8392-3ba99aab8065 service nova] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.038415 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c9b145a-ba6b-4a40-abf7-fc513bda3ed7 req-3aba3ef8-2aa7-45ba-8392-3ba99aab8065 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.038474 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2c9b145a-ba6b-4a40-abf7-fc513bda3ed7 req-3aba3ef8-2aa7-45ba-8392-3ba99aab8065 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:44.038657 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2c9b145a-ba6b-4a40-abf7-fc513bda3ed7 req-3aba3ef8-2aa7-45ba-8392-3ba99aab8065 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Processing event network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:53:44.049711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.049711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.049711 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.049961 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.050023 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:44.052856 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Terminating instance
May 14 03:53:44.143483 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.180965 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.181993 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.184236 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.185489 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.201053 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.558136 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:53:44.575124 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.577017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.592963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.622970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:53:44.623366 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730824.6231332, a5866afe-e285-4ea3-9f02-19530c3290a4 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:44.623517 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] VM Started (Lifecycle Event)
May 14 03:53:44.627549 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:53:44.630263 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance spawned successfully.
May 14 03:53:44.630556 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:53:44.661212 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.661382 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.661593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.661790 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.661958 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:44.664105 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Terminating instance
May 14 03:53:44.687550 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.692678 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:44.711262 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:44.711650 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:44.711908 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:44.712110 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:44.712244 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] No waiting events found dispatching network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:44.712357 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-40069903-201e-46a2-bed8-4eaba3bce00f req-f35a20f5-e66a-411b-a92b-13b09663b562 service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:44.874548 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Instance destroyed successfully.
May 14 03:53:44.874695 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'resources' on Instance uuid 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:45.126106 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:45.127970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:53:45.136327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.136446 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.136743 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.136967 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.137263 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.137513 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:53:45.167037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:53:45.205546 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.221091 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.237161 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.257491 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.377099 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1468206622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1468206622',id=79,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:53:01Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-v708w0vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=7ffc3f7d-8e3d-423d-a189-8f408bed85a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:53:45.377353 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6bf18843-a222-41bb-b135-8da288b8012b", "address": "fa:16:3e:c8:51:45", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf18843-a2", "ovs_interfaceid": "6bf18843-a222-41bb-b135-8da288b8012b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:45.377937 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:45.378230 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:53:45.379937 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.380181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bf18843-a2, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:45.381214 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.381767 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:45.387391 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.388241 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.388425 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76f88348-86ab-4e78-b44b-01a9bb52460f) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:45.389028 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.389518 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:45.394190 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:45.396525 np0000000741 nova-compute[97948]: INFO os_vif [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:51:45,bridge_name='br-int',has_traffic_filtering=True,id=6bf18843-a222-41bb-b135-8da288b8012b,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf18843-a2')
May 14 03:53:45.396847 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Deleting instance files /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4_del
May 14 03:53:45.397559 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Deletion of /opt/stack/data/nova/instances/7ffc3f7d-8e3d-423d-a189-8f408bed85a4_del complete
May 14 03:53:45.490257 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Instance destroyed successfully.
May 14 03:53:45.490688 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lazy-loading 'resources' on Instance uuid 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:45.630275 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:53:45.630752 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730825.6303618, a5866afe-e285-4ea3-9f02-19530c3290a4 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:45.630752 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] VM Paused (Lifecycle Event)
May 14 03:53:45.642127 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Took 8.87 seconds to spawn the instance on the hypervisor.
May 14 03:53:45.642559 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:45.903767 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 03:53:45.904408 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:53:45.904733 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:53:45.904911 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:53:45.905196 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:45.964283 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:45.995729 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1516623699',display_name='tempest-TestVolumeBootPatternV346-server-1516623699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-testvolumebootpatternv346-server-1516623699',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWG2gdDE0/f9vFAT7stLcCRSAvDr0nqf+NxcgPx2mXc7/b+smFKk41M7QiFumtNjm08ovsMV7TZmWDgfr2ANCR3WNLQJeWrYiN4bey6UOdXKLncfc0faTyNjBJ523neww==',key_name='tempest-keypair-508110720',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:50:44Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d963dbf38a7f450c88af23dc0786e125',ramdisk_id='',reservation_id='r-gol3k806',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1499777380',owner_user_name='tempest-TestVolumeBootPatternV346-1499777380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1502fd1ebb564a38a0329ad56584a769',uuid=3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:53:45.995944 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converting VIF {"id": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "address": "fa:16:3e:5f:c2:6b", "network": {"id": "dc010007-5813-4b45-bd94-bae3a88daea3", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-310703533-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d963dbf38a7f450c88af23dc0786e125", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap400adc7c-85", "ovs_interfaceid": "400adc7c-85ac-46d1-b0ef-9fac13a3f90f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:53:45.996524 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:53:45.996775 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:53:45.999871 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:46.000057 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap400adc7c-85, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:46.002230 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:46.003297 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:46.005372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:46.005503 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01747622-71cd-49cf-a9cd-9db0ac7c56a9) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:53:46.006468 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:46.007243 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:53:46.008691 np0000000741 nova-compute[97948]: INFO os_vif [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c2:6b,bridge_name='br-int',has_traffic_filtering=True,id=400adc7c-85ac-46d1-b0ef-9fac13a3f90f,network=Network(dc010007-5813-4b45-bd94-bae3a88daea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400adc7c-85')
May 14 03:53:46.010250 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:46.010539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:46.010690 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:46.011130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:46.011545 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72b3e82b-127c-4af5-8457-3070ef0ed0d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:46.011837 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:46.040526 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:46.040834 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:46.041030 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:46.041093 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '197')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:46.042388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2', '198')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:46.043599 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b045a520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'): ({'sde'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:46.044123 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Removing multipathed devices sdd, sde {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:46.044393 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Flush multipath device 3300000005e57ccf7 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:46.098601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:46.133579 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:46.135636 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730826.1354187, a5866afe-e285-4ea3-9f02-19530c3290a4 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:46.135789 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] VM Resumed (Lifecycle Event)
May 14 03:53:46.138409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:46.154621 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Took 16.44 seconds to build instance.
May 14 03:53:46.181069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:46.181222 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:46.182286 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:46.193664 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:46.193907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:46.211936 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.270419 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.40.100,3260]
May 14 03:53:46.270419 np0000000741 nova-compute[97948]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.40.100,3260] successful.
May 14 03:53:46.270419 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.289304 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.301741 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.332139 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.50.100,3260]
May 14 03:53:46.332139 np0000000741 nova-compute[97948]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-72b3e82b-127c-4af5-8457-3070ef0ed0d2, portal: 192.168.50.100,3260] successful.
May 14 03:53:46.332139 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.350753 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:46.350979 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:46.351097 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] <== disconnect_volume: return (340ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:46.351231 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:46.351530 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Deleting instance files /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b_del
May 14 03:53:46.352022 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Deletion of /opt/stack/data/nova/instances/3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b_del complete
May 14 03:53:46.607597 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:46.607932 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:46.608086 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:46.608210 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:46.608367 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] No waiting events found dispatching network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:46.608487 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received unexpected event network-vif-plugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e for instance with vm_state active and task_state None.
May 14 03:53:46.608703 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:46.608703 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:46.608833 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:46.608933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:46.609032 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] No waiting events found dispatching network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:46.609129 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:46.609275 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:46.609372 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Acquiring lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:46.609479 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:46.609583 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:46.609697 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] No waiting events found dispatching network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:46.609802 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-859966f0-d9a9-4b65-a55f-0b71e25d1f7a req-54cabd75-679d-4452-9c6f-87fdefe61124 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-unplugged-400adc7c-85ac-46d1-b0ef-9fac13a3f90f for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:46.637970 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:46.640118 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:53:46.656526 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.948s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:46.768333 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:46.768609 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] Acquiring lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:46.768964 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:46.769068 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:46.769248 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] No waiting events found dispatching network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:53:46.769296 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-unplugged-6bf18843-a222-41bb-b135-8da288b8012b for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:53:46.769421 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Received event network-vif-deleted-6bf18843-a222-41bb-b135-8da288b8012b {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:46.769592 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Neutron deleted interface 6bf18843-a222-41bb-b135-8da288b8012b; detaching it from the instance and deleting it from the info cache
May 14 03:53:46.769776 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:46.859367 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Took 1.69 seconds to destroy the instance on the hypervisor.
May 14 03:53:46.862077 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:53:46.862077 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:53:46.862188 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:53:46.862439 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:46.875396 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:46.961214 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:47.142292 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999737234999884 future=<Future at 0x79d0b81a3260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:47.142462 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999897239999882 future=<Future at 0x79d0b018b080 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:47.276596 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2b52390d-6cc1-4c32-8a6a-f8074aa03c91 req-2360bb45-3ff0-4b44-85fd-9dba0f68e81c service nova] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Detach interface failed, port_id=6bf18843-a222-41bb-b135-8da288b8012b, reason: Instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:53:47.390578 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Took 1.49 seconds to deallocate network for instance.
May 14 03:53:47.787582 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:47.896291 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:47.896451 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:48.083785 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:48.084047 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:48.289420 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Took 1.43 seconds to deallocate network for instance.
May 14 03:53:48.586509 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:48.659378 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-15022fd0-9a1e-463c-83fe-40cc3b8fbe2b req-75361858-f1bb-4020-9dce-bddc54b86c56 service nova] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Received event network-vif-deleted-400adc7c-85ac-46d1-b0ef-9fac13a3f90f {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:48.827601 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-changed-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:53:48.828059 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Refreshing instance network info cache due to event network-changed-2aa207c3-60a2-4541-b1bd-4b20276a7e2e. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:53:48.828281 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] Acquiring lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:53:48.828399 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] Acquired lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:53:48.828551 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Refreshing network info cache for port 2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:53:48.838149 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:53:49.093377 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.197s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:49.144050 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:49.171385 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Deleted allocations for instance 7ffc3f7d-8e3d-423d-a189-8f408bed85a4
May 14 03:53:49.330960 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:49.343570 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:49.343809 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:49.558677 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:53:49.558886 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:53:49.659375 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:53:49.791724 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updated VIF entry in instance network info cache for port 2aa207c3-60a2-4541-b1bd-4b20276a7e2e. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:53:49.791989 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updating instance_info_cache with network_info: [{"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:53:49.816763 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003531329998622823 future=<Future at 0x79d0b0178e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:49.817342 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Emitting event <LifecycleEvent: 1778730814.8163116, 0d29382d-ccc4-4065-9351-d448a9e7d199 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:53:49.817708 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:49.817875 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] VM Stopped (Lifecycle Event)
May 14 03:53:49.818872 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.323123565999595 future=<Future at 0x79d0b81a3260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:49.819059 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=12.322941509999964 future=<Future at 0x79d0b81a3260 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:53:50.061973 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:53:50.181771 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-99659017-8697-4bce-86fa-2a76e87f0a2e tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "7ffc3f7d-8e3d-423d-a189-8f408bed85a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.132s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:50.293736 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-f8bcab2b-9484-420d-a200-eefbe7513a46 req-97cf6c8f-2741-42df-ba17-9d9056d3a73c service nova] Releasing lock "refresh_cache-a5866afe-e285-4ea3-9f02-19530c3290a4" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:53:50.320192 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c0194f5d-f301-4607-b16f-3ce3396b30cf tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: 0d29382d-ccc4-4065-9351-d448a9e7d199] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:53:50.548058 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:50.548263 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:50.568543 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.225s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:50.616766 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Deleted allocations for instance 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b
May 14 03:53:51.006856 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:51.050574 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Detaching volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99
May 14 03:53:51.081990 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to driver detach volume e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 from mountpoint /dev/vdd
May 14 03:53:51.086144 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdd by alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:51.087168 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdd by alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:51.087275 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Attempting to detach device vdd from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:53:51.087487 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <target dev="vdd" bus="virtio"/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:51.087487 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:51.092244 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdd from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config.
May 14 03:53:51.092391 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] (1/8): Attempting to detach device vdd with device alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:53:51.092972 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <alias name="ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99"/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-11"/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <target dev="vdd" bus="virtio"/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <serial>e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99</serial>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:51.092972 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:51.574208 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730831.573833, a48e0d44-3f51-427a-9204-24e2a87f8f9a => ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:53:51.575229 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 for instance a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:53:51.577540 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdd from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config.
May 14 03:53:51.602543 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:51.602817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:51.602922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:51.603188 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:51.603496 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:51.603657 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:51.624436 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-393ff5e6-dd7d-42b4-8282-5a0a58d603d8 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Lock "3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.963s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:51.629124 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:51.629407 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:51.629407 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:51.629631 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '213')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:51.630532 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99', '212')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:51.631257 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b81462a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'): ({'sdl'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:51.631418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Removing multipathed devices sdm, sdl {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:51.631601 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flush multipath device 3300000007f6e8c7f {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:51.674189 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:51.720073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:51.761268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:51.761481 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:51.762918 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:51.772748 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:51.772954 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:51.783900 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.812696 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.40.100,3260]
May 14 03:53:51.812696 np0000000741 nova-compute[97948]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.40.100,3260] successful.
May 14 03:53:51.812696 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.828095 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.838040 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.874569 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.50.100,3260]
May 14 03:53:51.874569 np0000000741 nova-compute[97948]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-e3d1cb6f-7611-4bfb-9e86-c4e6d3c4ad99, portal: 192.168.50.100,3260] successful.
May 14 03:53:51.874569 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.891268 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:51.891425 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:51.891539 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== disconnect_volume: return (288ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:51.891653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:52.437392 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:53.442577 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-110f4625-ce0f-4f65-8000-522d7b7011df tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.894s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:53.836277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:53.836483 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:54.145188 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:54.341346 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Detaching volume bcb03416-1cbe-4f93-833b-e1b158eedde9
May 14 03:53:54.398665 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to driver detach volume bcb03416-1cbe-4f93-833b-e1b158eedde9 from mountpoint /dev/vdc
May 14 03:53:54.426697 np0000000741 nova-compute[97948]: DEBUG os_brick.encryptors [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'a48e0d44-3f51-427a-9204-24e2a87f8f9a', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'serial': 'bcb03416-1cbe-4f93-833b-e1b158eedde9'} {{(pid=97948) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 03:53:54.430128 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdc by alias ua-bcb03416-1cbe-4f93-833b-e1b158eedde9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:54.431197 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdc by alias ua-bcb03416-1cbe-4f93-833b-e1b158eedde9 {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:54.431327 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Attempting to detach device vdc from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:53:54.431567 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <alias name="ua-bcb03416-1cbe-4f93-833b-e1b158eedde9"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <serial>bcb03416-1cbe-4f93-833b-e1b158eedde9</serial>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="ff454fbd-87b9-4f6d-a731-591d78a36db1"/>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:54.431567 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:54.436655 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdc from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config.
May 14 03:53:54.436774 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] (1/8): Attempting to detach device vdc with device alias ua-bcb03416-1cbe-4f93-833b-e1b158eedde9 from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:53:54.436958 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <alias name="ua-bcb03416-1cbe-4f93-833b-e1b158eedde9"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <target dev="vdc" bus="virtio"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <serial>bcb03416-1cbe-4f93-833b-e1b158eedde9</serial>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   <encryption format="luks">
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:     <secret type="passphrase" uuid="ff454fbd-87b9-4f6d-a731-591d78a36db1"/>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:   </encryption>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:54.436958 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:54.943205 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:54.960338 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730834.9592483, a48e0d44-3f51-427a-9204-24e2a87f8f9a => ua-bcb03416-1cbe-4f93-833b-e1b158eedde9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:53:54.960756 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-bcb03416-1cbe-4f93-833b-e1b158eedde9 for instance a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:53:54.964396 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdc from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config.
May 14 03:53:54.965927 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:54.966200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:54.966471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:54.966804 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:54.967069 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb03416-1cbe-4f93-833b-e1b158eedde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:54.967164 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:54.996698 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9 (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:54.996975 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:54.996975 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:54.997161 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '208')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:54.997898 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9', '209')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:54.998609 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b8147ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'): ({'sdj'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:54.998817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Removing multipathed devices sdj, sdi {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:54.999026 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flush multipath device 3300000000a0b6c57 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:55.029328 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:55.079170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:55.132088 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:55.132261 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:55.133130 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:55.144409 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:55.144624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:55.156048 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.185043 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.40.100,3260]
May 14 03:53:55.185043 np0000000741 nova-compute[97948]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.40.100,3260] successful.
May 14 03:53:55.185043 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.200279 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.217306 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.251948 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.50.100,3260]
May 14 03:53:55.251948 np0000000741 nova-compute[97948]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-bcb03416-1cbe-4f93-833b-e1b158eedde9, portal: 192.168.50.100,3260] successful.
May 14 03:53:55.251948 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.266960 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:55.268853 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:55.268973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== disconnect_volume: return (302ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:55.269091 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:55.810324 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:56.008241 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:56.816227 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-97686504-4b6a-4aef-8ef6-64c0d7e99fc6 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.980s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:53:57.016231 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:53:57.121082 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:53:57.121275 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:53:57.623962 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Detaching volume 7fde383d-db2b-4e8a-8746-02ea222f843a
May 14 03:53:57.670220 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Attempting to driver detach volume 7fde383d-db2b-4e8a-8746-02ea222f843a from mountpoint /dev/vdb
May 14 03:53:57.679296 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-7fde383d-db2b-4e8a-8746-02ea222f843a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:57.680622 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-7fde383d-db2b-4e8a-8746-02ea222f843a {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:53:57.680833 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Attempting to detach device vdb from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:53:57.681065 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <alias name="ua-7fde383d-db2b-4e8a-8746-02ea222f843a"/>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <serial>7fde383d-db2b-4e8a-8746-02ea222f843a</serial>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:57.681065 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:57.687388 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the persistent domain config.
May 14 03:53:57.687551 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] (1/8): Attempting to detach device vdb with device alias ua-7fde383d-db2b-4e8a-8746-02ea222f843a from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:53:57.687816 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <alias name="ua-7fde383d-db2b-4e8a-8746-02ea222f843a"/>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-4"/>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <serial>7fde383d-db2b-4e8a-8746-02ea222f843a</serial>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]: </disk>
May 14 03:53:57.687816 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:53:58.146299 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730838.1455016, a48e0d44-3f51-427a-9204-24e2a87f8f9a => ua-7fde383d-db2b-4e8a-8746-02ea222f843a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:53:58.147410 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7fde383d-db2b-4e8a-8746-02ea222f843a for instance a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:53:58.149484 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance a48e0d44-3f51-427a-9204-24e2a87f8f9a from the live domain config.
May 14 03:53:58.150484 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:53:58.150784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:53:58.150923 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:53:58.151275 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:53:58.151517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fde383d-db2b-4e8a-8746-02ea222f843a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:53:58.151628 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:53:58.177254 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:58.177254 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:58.177254 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:58.177254 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:58.177254 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:53:58.177451 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:58.177451 np0000000741 nova-compute[97948]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a (non-flash)
May 14 03:53:58.177451 np0000000741 nova-compute[97948]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:58.177451 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:53:58.177451 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:53:58.177556 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:53:58.177659 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '206')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:58.178530 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a', '205')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:53:58.179276 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b85fb100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'): ({'sdg'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:53:58.179466 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Removing multipathed devices sdh, sdg {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:53:58.179736 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flush multipath device 33000000029aa25ce {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:53:58.218273 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:58.272140 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:53:58.325896 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:53:58.326036 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:53:58.326739 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:53:58.338723 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:53:58.338866 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:53:58.349470 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.378471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.40.100,3260]
May 14 03:53:58.378471 np0000000741 nova-compute[97948]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.40.100,3260] successful.
May 14 03:53:58.378471 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.391928 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.405249 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.438732 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.50.100,3260]
May 14 03:53:58.438732 np0000000741 nova-compute[97948]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-7fde383d-db2b-4e8a-8746-02ea222f843a, portal: 192.168.50.100,3260] successful.
May 14 03:53:58.438732 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.451874 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:53:58.452073 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:53:58.452200 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== disconnect_volume: return (301ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:53:58.452311 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:53:58.995698 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:53:59.146316 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:00.001250 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-8128e88d-84ee-4eff-818c-058deeb05977 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.880s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:01.010017 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:02.142437 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0003547790001903195 future=<Future at 0x79d0b81a3260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:02.142989 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] Emitting event <LifecycleEvent: 1778730827.1419365, 7ffc3f7d-8e3d-423d-a189-8f408bed85a4 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:02.143188 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:02.143394 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] VM Stopped (Lifecycle Event)
May 14 03:54:02.144301 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.001928351000060502 future=<Future at 0x79d0b018b080 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:02.144446 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0020857409999734955 future=<Future at 0x79d0b018b080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:02.144807 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Emitting event <LifecycleEvent: 1778730827.1423197, 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:02.144909 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:02.145675 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] VM Stopped (Lifecycle Event)
May 14 03:54:02.645949 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b90c019f-afb1-47ed-b961-f54e5ec0e1fa tempest-TestServerVolumeAttachScenarioOldVersion-1000356356 tempest-TestServerVolumeAttachScenarioOldVersion-1000356356-project-member] [instance: 7ffc3f7d-8e3d-423d-a189-8f408bed85a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:02.647323 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-11a179b0-51e1-4897-9e10-62c0cff8a227 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: 3a8ddb53-acb2-4cd0-9adb-4ecf6e6cf89b] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:03.688541 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:03.688939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:03.688939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:03.688939 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:03.689026 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:03.690770 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Terminating instance
May 14 03:54:04.157067 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.193609 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:54:04.212205 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.228437 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.233963 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.253237 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.351102 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:04.351679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:04.351679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:04.351679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:04.351879 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] No waiting events found dispatching network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:54:04.351879 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-6f9d8e08-6189-4920-bb9f-bb4cad6b3811 req-c69b5ee7-5a37-44d2-8069-dad87456ccec service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:54:04.491012 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.497104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:04.524106 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999701529999584 future=<Future at 0x79d0b046acf0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:04.524519 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999355130999902 future=<Future at 0x79d0b046acf0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:04.524519 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999265333999574 future=<Future at 0x79d0b046acf0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:04.526942 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Instance destroyed successfully.
May 14 03:54:04.527966 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'resources' on Instance uuid a48e0d44-3f51-427a-9204-24e2a87f8f9a {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:54:05.030051 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1136494025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-1136494025',id=76,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY/m9myOGN2aSTJ/T264pAVWPCRcTlgk9B9uLUW9Eh8z0MLYlnrJrwf/S82xdtGQVbO/08usmfaCPESIAkkxkiya9azoqdS+d6Dh+WSPQwbvBwCJfglAH7e0yqoYjjxYA==',key_name='tempest-keypair-1235313295',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:51:28Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-vxznk3qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=a48e0d44-3f51-427a-9204-24e2a87f8f9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:54:05.030576 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "address": "fa:16:3e:7d:0e:28", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11bdd3e-60", "ovs_interfaceid": "f11bdd3e-60c3-4754-80a8-7bd20f9fe014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:54:05.030701 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:54:05.030906 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:54:05.032434 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:05.032629 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf11bdd3e-60, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:05.033494 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:05.035403 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:05.035895 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:05.036068 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ec2da7b-0fe0-4964-8630-01ae03a0f3b0) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:05.036495 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:05.037041 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:05.037329 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:05.038811 np0000000741 nova-compute[97948]: INFO os_vif [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0e:28,bridge_name='br-int',has_traffic_filtering=True,id=f11bdd3e-60c3-4754-80a8-7bd20f9fe014,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11bdd3e-60')
May 14 03:54:05.039040 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Deleting instance files /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a_del
May 14 03:54:05.039714 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Deletion of /opt/stack/data/nova/instances/a48e0d44-3f51-427a-9204-24e2a87f8f9a_del complete
May 14 03:54:05.545800 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 03:54:05.546340 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:54:05.546740 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:54:05.546826 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:54:05.547032 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:05.648223 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:06.367271 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:54:06.419890 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:06.420090 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] Acquiring lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:06.420426 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:06.420564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:06.420911 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] No waiting events found dispatching network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:54:06.420911 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-unplugged-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:54:06.421007 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2ea69dea-fbbd-4e94-80cd-6395fd4e8df0 req-03785bad-f094-424a-9387-19e56349f735 service nova] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Received event network-vif-deleted-f11bdd3e-60c3-4754-80a8-7bd20f9fe014 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:06.869185 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Took 1.32 seconds to deallocate network for instance.
May 14 03:54:07.375434 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:07.375891 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:07.540424 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:54:07.540827 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:54:08.043460 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:54:08.550535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:08.619629 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Deleted allocations for instance a48e0d44-3f51-427a-9204-24e2a87f8f9a
May 14 03:54:09.168519 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:09.627203 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-666ee51b-0810-45d5-892f-9014a3f3196b tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "a48e0d44-3f51-427a-9204-24e2a87f8f9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.938s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:10.037294 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:13.985963 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:13.986315 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:14.174432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:14.487971 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Starting instance... {{(pid=97948) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 03:54:15.034495 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:15.034870 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:15.037866 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97948) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 03:54:15.038012 np0000000741 nova-compute[97948]: INFO nova.compute.claims [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Claim successful on node np0000000741
May 14 03:54:15.040277 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:16.159302 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:54:16.159746 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:54:16.661649 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:54:17.167413 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.133s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:17.167892 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Start building networks asynchronously for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 03:54:17.673157 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Allocating IP information in the background. {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 03:54:17.673449 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] allocate_for_instance() {{(pid=97948) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 03:54:17.673734 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:17.674034 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:17.736709 np0000000741 nova-compute[97948]: DEBUG nova.policy [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27cad4e205374f8b8879c440af287684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2107e69e4f24f49ad24e398462243ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97948) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 03:54:18.168252 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Successfully created port: 6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 03:54:18.176183 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 03:54:18.589375 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Successfully updated port: 6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 03:54:18.645284 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-changed-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:18.645394 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Refreshing instance network info cache due to event network-changed-6e45278e-9190-40f1-94ca-7bbb1649bd84. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:54:18.645564 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] Acquiring lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:54:18.645669 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] Acquired lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:54:18.645786 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Refreshing network info cache for port 6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:54:18.679045 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Start building block device mappings for instance. {{(pid=97948) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 03:54:19.092515 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:54:19.147665 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:19.175220 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:19.218570 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:54:19.343499 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:54:19.524364 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.0005365970000639209 future=<Future at 0x79d0b046acf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:19.524801 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Emitting event <LifecycleEvent: 1778730844.5237043, a48e0d44-3f51-427a-9204-24e2a87f8f9a => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:19.524971 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] VM Stopped (Lifecycle Event)
May 14 03:54:19.525859 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:19.686174 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Start spawning the instance on the hypervisor. {{(pid=97948) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 03:54:19.686903 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Creating instance directory {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 03:54:19.687128 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Creating image(s)
May 14 03:54:19.687607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:19.687764 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:19.688148 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:19.688596 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:54:19.690945 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:54:19.691732 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:19.777257 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.085s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:19.777607 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:19.778054 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:19.778520 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:54:19.781021 np0000000741 nova-compute[97948]: DEBUG oslo_utils.imageutils.format_inspector [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97948) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 03:54:19.781316 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:19.846366 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-411e9d4d-6766-4e73-b320-be3ee96e83d2 req-dca23b0b-fcaa-4f0e-8b37-70e8718b6927 service nova] Releasing lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:54:19.847363 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquired lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:54:19.847363 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Building network info cache for instance {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 03:54:19.869923 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:19.870277 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk 1073741824 {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:19.924768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282,backing_fmt=raw /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk 1073741824" returned: 0 in 0.054s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:19.925621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "ce99b72313d69cc6a7142b17eed6d6d9926a2282" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:19.925746 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:20.010183 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce99b72313d69cc6a7142b17eed6d6d9926a2282 --force-share --output=json" returned: 0 in 0.084s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:20.010593 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk. size=1073741824 {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 03:54:20.010836 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:20.029339 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: a48e0d44-3f51-427a-9204-24e2a87f8f9a] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:20.042999 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:20.097098 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:20.097448 np0000000741 nova-compute[97948]: DEBUG nova.virt.disk.api [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Cannot resize image /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk to a smaller size. {{(pid=97948) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 03:54:20.097814 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Created local disks {{(pid=97948) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 03:54:20.097967 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Ensure instance console log exists: /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/console.log {{(pid=97948) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 03:54:20.098219 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:20.098453 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:20.098578 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:20.409533 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance cache missing network info. {{(pid=97948) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 03:54:20.542590 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:20.666996 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating instance_info_cache with network_info: [{"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:54:21.169154 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Releasing lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:54:21.169405 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance network_info: |[{"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97948) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 03:54:21.170964 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Start _get_guest_xml network_info=[{"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'image_id': '6612e57f-dc02-432a-8f21-51e588d0e5b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 03:54:21.173549 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:54:21.174802 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6612e57f-dc02-432a-8f21-51e588d0e5b8', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-2049535446', uuid='bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5'), owner=OwnerMeta(userid='27cad4e205374f8b8879c440af287684', username='tempest-VolumeMultiattachTests-1122220317-project-member', projectid='e2107e69e4f24f49ad24e398462243ac', projectname='tempest-VolumeMultiattachTests-1122220317'), image=ImageMeta(id='6612e57f-dc02-432a-8f21-51e588d0e5b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778730861.1744785) {{(pid=97948) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 03:54:21.176241 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V1... {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 03:54:21.176562 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller missing on host. {{(pid=97948) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 03:54:21.177479 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching host: 'np0000000741' for CPU controller through CGroups V2... {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 03:54:21.177653 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.host [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU controller found on host. {{(pid=97948) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 03:54:21.178498 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97948) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 03:54:21.178832 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T03:30:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T03:30:37Z,direct_url=<?>,disk_format='qcow2',id=6612e57f-dc02-432a-8f21-51e588d0e5b8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='92799915210a494dadc223bfcfad6c66',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T03:30:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 03:54:21.178986 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 03:54:21.179112 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image limits 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 03:54:21.179229 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flavor pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 03:54:21.179324 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Image pref 0:0:0 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 03:54:21.179420 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 03:54:21.179572 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 03:54:21.179686 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 03:54:21.179826 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got 1 possible topologies {{(pid=97948) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 03:54:21.179938 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 03:54:21.180091 np0000000741 nova-compute[97948]: DEBUG nova.virt.hardware [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97948) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 03:54:21.190272 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2049535446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-2049535446',id=81,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTs0wpn8F4YskRGnQ1yZGYi5+1H+GLSOEVLzVDLFinl1yF/Oh3evzYjQxXa+or8dqpUEktjqVKdKLl5gRU36/KOVxNRK8khp1Z88PZrpK7fHALcfAf4/8h7VqYWtVhVEQ==',key_name='tempest-keypair-1020383361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-h6mnzn29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97948) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 03:54:21.190437 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:54:21.190972 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:54:21.191468 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'pci_devices' on Instance uuid bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:54:21.694175 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] End _get_guest_xml xml=<domain type="qemu">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <uuid>bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5</uuid>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <name>instance-00000051</name>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <memory>196608</memory>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <vcpu>1</vcpu>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <metadata>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:package version="33.1.0"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:name>tempest-VolumeMultiattachTests-server-2049535446</nova:name>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:creationTime>2026-05-14 03:54:21</nova:creationTime>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:flavor name="m1.nano" id="42">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:memory>192</nova:memory>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:disk>1</nova:disk>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:swap>0</nova:swap>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:ephemeral>0</nova:ephemeral>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:vcpus>1</nova:vcpus>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:extraSpecs>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         </nova:extraSpecs>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       </nova:flavor>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:image uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:minDisk>1</nova:minDisk>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:minRam>0</nova:minRam>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:properties>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         </nova:properties>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       </nova:image>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:owner>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:user uuid="27cad4e205374f8b8879c440af287684">tempest-VolumeMultiattachTests-1122220317-project-member</nova:user>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:project uuid="e2107e69e4f24f49ad24e398462243ac">tempest-VolumeMultiattachTests-1122220317</nova:project>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       </nova:owner>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:root type="image" uuid="6612e57f-dc02-432a-8f21-51e588d0e5b8"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <nova:ports>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         <nova:port uuid="6e45278e-9190-40f1-94ca-7bbb1649bd84">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:         </nova:port>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       </nova:ports>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </nova:instance>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </metadata>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <sysinfo type="smbios">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <system>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="product">OpenStack Nova</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="version">33.1.0</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="serial">bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="uuid">bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <entry name="family">Virtual Machine</entry>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </system>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </sysinfo>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <os>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <boot dev="hd"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <smbios mode="sysinfo"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </os>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <features>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <acpi/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <tcg>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <tb-cache unit="MiB">128</tb-cache>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </tcg>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <vmcoreinfo/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </features>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <iothreads>1</iothreads>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <clock offset="utc"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <cpu mode="custom" match="exact">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <model>Nehalem</model>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <topology sockets="1" cores="1" threads="1"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </cpu>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   <devices>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <disk type="file" device="disk">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <target dev="vda" bus="virtio"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </disk>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <disk type="file" device="cdrom">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <driver name="qemu" type="raw" cache="none"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <source file="/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.config"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <target dev="hda" bus="ide"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </disk>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <interface type="ethernet">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <mac address="fa:16:3e:ef:5b:74"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <driver name="qemu"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <mtu size="1372"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <target dev="tap6e45278e-91"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </interface>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <serial type="pty">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <log file="/opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/console.log" append="off"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </serial>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <video>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <model type="virtio"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </video>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <rng model="virtio">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <backend model="random">/dev/urandom</backend>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </rng>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <controller type="usb" index="0" model="none"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:       <stats period="10"/>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:     </memballoon>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:   </devices>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]: </domain>
May 14 03:54:21.694175 np0000000741 nova-compute[97948]:  {{(pid=97948) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Preparing to wait for external event network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T03:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2049535446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-2049535446',id=81,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTs0wpn8F4YskRGnQ1yZGYi5+1H+GLSOEVLzVDLFinl1yF/Oh3evzYjQxXa+or8dqpUEktjqVKdKLl5gRU36/KOVxNRK8khp1Z88PZrpK7fHALcfAf4/8h7VqYWtVhVEQ==',key_name='tempest-keypair-1020383361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-h6mnzn29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T03:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:54:21.696694 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91') {{(pid=97948) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 03:54:21.697135 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.697174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:21.697451 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 03:54:21.698055 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.698237 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32d5a262-95b9-5d57-aaaf-e069538485e2', '_type': 'linux-noop'}}, row=False) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:21.709860 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.710650 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:21.712585 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.712749 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e45278e-91, may_exist=True, interface_attrs={}) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:21.713039 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e45278e-91, col_values=(('qos', UUID('558b68fb-4371-4510-9c13-2a5fa5ec7807')),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:21.713182 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e45278e-91, col_values=(('external_ids', {'iface-id': '6e45278e-9190-40f1-94ca-7bbb1649bd84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:5b:74', 'vm-uuid': 'bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5'}),), if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:21.713905 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.715021 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:21.719972 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:21.721011 np0000000741 nova-compute[97948]: INFO os_vif [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91')
May 14 03:54:23.237732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:54:23.237732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:54:23.237732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:ef:5b:74, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:54:23.238227 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Using config drive
May 14 03:54:23.743083 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:23.850541 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Creating config drive at /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.config
May 14 03:54:23.854119 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmw95b_wu {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:23.918390 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmw95b_wu" returned: 0 in 0.064s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:23.923238 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:23.925512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:23.925512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:23.925512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:23.925512 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:23.927782 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Terminating instance
May 14 03:54:24.177291 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.308000 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.327320 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.328586 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.418922 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.432167 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:54:24.459934 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.461952 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.477836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.487046 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2f2dde73-0a3c-422c-ad11-5f2125943446 req-88b7ed08-2bec-418d-b82f-d6a2a10751e4 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:24.487150 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2f2dde73-0a3c-422c-ad11-5f2125943446 req-88b7ed08-2bec-418d-b82f-d6a2a10751e4 service nova] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:24.487352 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2f2dde73-0a3c-422c-ad11-5f2125943446 req-88b7ed08-2bec-418d-b82f-d6a2a10751e4 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:24.487411 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-2f2dde73-0a3c-422c-ad11-5f2125943446 req-88b7ed08-2bec-418d-b82f-d6a2a10751e4 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:24.487540 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-2f2dde73-0a3c-422c-ad11-5f2125943446 req-88b7ed08-2bec-418d-b82f-d6a2a10751e4 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Processing event network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 03:54:24.597569 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.602457 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.606094 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.624382 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:24.624382 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:24.624535 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:24.624588 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:24.624720 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] No waiting events found dispatching network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:54:24.624843 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-cffb5ae2-812d-4265-b11e-d92a3ef1f9ab req-6011757b-cd57-44ae-8459-ce82332fc2b7 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:54:24.626155 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.631650 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.760070 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:24.774964 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999670702000003 future=<Future at 0x79d0b044d9d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:24.775782 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998780731000352 future=<Future at 0x79d0b044d9d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:24.775888 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998671560000275 future=<Future at 0x79d0b044d9d0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:24.778563 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Instance destroyed successfully.
May 14 03:54:24.779009 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lazy-loading 'resources' on Instance uuid a5866afe-e285-4ea3-9f02-19530c3290a4 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:54:24.783335 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.067986 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730865.0675406, bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 => Started> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:25.068085 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] VM Started (Lifecycle Event)
May 14 03:54:25.069318 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97948) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 03:54:25.072189 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Guest created on hypervisor {{(pid=97948) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 03:54:25.074378 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance spawned successfully.
May 14 03:54:25.074732 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 03:54:25.282079 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-673818495',display_name='tempest-instance-673818495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-instance-673818495',id=80,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpCRNomXuU4T+FODEpxJcwrMJJh6oJXgemqDrtYKrz74nevkQi6dddp5Hw1lmVNvkbtSKl0HmjhRz90+avNKTo7YxcMk4C5eHtbFnGaq0+DnhwlOODKCA06ENqFP1L4Q==',key_name='tempest-keypair-2063575954',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:53:45Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a000d5b9f598473f96f349a002a80625',ramdisk_id='',reservation_id='r-abhs6q0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-728151775',owner_user_name='tempest-VolumesBackupsTest-728151775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a2661ee6fd54baa9ce229bf9dfb845e',uuid=a5866afe-e285-4ea3-9f02-19530c3290a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:54:25.282346 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converting VIF {"id": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "address": "fa:16:3e:0d:dc:31", "network": {"id": "0cc1d570-cd12-466e-a819-5dc0edfc2b68", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1713277421-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a000d5b9f598473f96f349a002a80625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa207c3-60", "ovs_interfaceid": "2aa207c3-60a2-4541-b1bd-4b20276a7e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:54:25.283108 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:54:25.283656 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:54:25.286422 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.286422 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aa207c3-60, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:25.287603 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.288376 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:25.288625 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.289252 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.289859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bac362d0-f0f7-4ed2-96da-71b4779d7420) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:54:25.289859 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.290513 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:54:25.291318 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:25.292974 np0000000741 nova-compute[97948]: INFO os_vif [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:dc:31,bridge_name='br-int',has_traffic_filtering=True,id=2aa207c3-60a2-4541-b1bd-4b20276a7e2e,network=Network(0cc1d570-cd12-466e-a819-5dc0edfc2b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa207c3-60')
May 14 03:54:25.294545 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:54:25.294626 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:54:25.294783 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:54:25.295418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:54:25.295418 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40c4a153-f078-4ee6-b422-eb11912029c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:54:25.295564 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fae19951-c8bb-44bd-b353-b7b3dffb2c8e (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7 (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fae19951-c8bb-44bd-b353-b7b3dffb2c8e (non-flash)
May 14 03:54:25.319551 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:54:25.319551 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fae19951-c8bb-44bd-b353-b7b3dffb2c8e', '220')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:54:25.321478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '217')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:54:25.321478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7', '218')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:54:25.321478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b82e5760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'): ({'sdc'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:54:25.321478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Removing multipathed devices sdc, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:54:25.321478 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Flush multipath device 330000000249a3ca4 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:54:25.396350 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:54:25.451056 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:54:25.501907 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:54:25.502049 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:54:25.502784 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:54:25.512497 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:54:25.512733 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:54:25.521829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.548260 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.40.100,3260]
May 14 03:54:25.548260 np0000000741 nova-compute[97948]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.40.100,3260] successful.
May 14 03:54:25.548260 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.559307 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.569350 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.570263 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:25.571940 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:54:25.583999 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_cdrom_bus of ide {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.584101 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_disk_bus of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.584393 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_input_bus of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.585381 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_pointer_model of None {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.585709 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_video_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.586291 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Found default for hw_vif_model of virtio {{(pid=97948) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 03:54:25.594750 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.50.100,3260]
May 14 03:54:25.594750 np0000000741 nova-compute[97948]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-40c4a153-f078-4ee6-b422-eb11912029c7, portal: 192.168.50.100,3260] successful.
May 14 03:54:25.594750 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.605831 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:54:25.606050 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:54:25.606205 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] <== disconnect_volume: return (311ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:54:25.606336 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:54:25.606575 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Deleting instance files /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4_del
May 14 03:54:25.607129 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Deletion of /opt/stack/data/nova/instances/a5866afe-e285-4ea3-9f02-19530c3290a4_del complete
May 14 03:54:26.074329 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 03:54:26.074618 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730866.0744004, bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 => Paused> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:26.074799 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] VM Paused (Lifecycle Event)
May 14 03:54:26.091159 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Took 6.40 seconds to spawn the instance on the hypervisor.
May 14 03:54:26.094985 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:26.115048 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Took 1.68 seconds to destroy the instance on the hypervisor.
May 14 03:54:26.116133 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:54:26.119662 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:54:26.119662 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:54:26.119662 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:26.220846 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:26.577056 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:26.579918 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Emitting event <LifecycleEvent: 1778730866.5796807, bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 => Resumed> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:26.580052 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] VM Resumed (Lifecycle Event)
May 14 03:54:26.589037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:26.589449 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:26.590475 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:26.590475 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:26.590475 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] No waiting events found dispatching network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:54:26.590475 np0000000741 nova-compute[97948]: WARNING nova.compute.manager [req-0237e055-df19-47e5-a40f-d4751f302ae9 req-a3b1cd40-3563-4588-917b-d8b8e5522e65 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received unexpected event network-vif-plugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 for instance with vm_state active and task_state None.
May 14 03:54:26.605954 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Took 11.61 seconds to build instance.
May 14 03:54:26.695078 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:26.695237 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] Acquiring lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:26.695534 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:26.695660 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:26.695790 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] No waiting events found dispatching network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:54:26.695914 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-5d82ac55-4c87-4ac1-b110-abd4b4956c2f req-f5c8636d-806c-4405-9561-7101595f7c89 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-unplugged-2aa207c3-60a2-4541-b1bd-4b20276a7e2e for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:54:27.082219 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:27.084398 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97948) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 03:54:27.107077 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-27dba031-e832-4dd0-bf62-997aa840c125 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.121s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:27.176814 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:54:27.679193 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Took 1.56 seconds to deallocate network for instance.
May 14 03:54:28.232517 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Took 0.55 seconds to detach 1 volumes for instance.
May 14 03:54:28.670028 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-73618616-b7fb-4af1-bb31-e00e4f8d8b99 req-ba39bdd7-7c65-4709-9511-a32d70bdbb22 service nova] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Received event network-vif-deleted-2aa207c3-60a2-4541-b1bd-4b20276a7e2e {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:28.737757 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:28.738253 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:28.763200 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-changed-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:54:28.763383 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Refreshing instance network info cache due to event network-changed-6e45278e-9190-40f1-94ca-7bbb1649bd84. {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 03:54:28.763606 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] Acquiring lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 03:54:28.763756 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] Acquired lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 03:54:28.764131 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Refreshing network info cache for port 6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 03:54:28.892480 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:54:28.892719 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:54:29.178259 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:29.268476 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:29.396676 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:54:29.627298 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:54:29.746793 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updated VIF entry in instance network info cache for port 6e45278e-9190-40f1-94ca-7bbb1649bd84. {{(pid=97948) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 03:54:29.747329 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating instance_info_cache with network_info: [{"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:54:29.904040 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.166s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:29.955567 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Deleted allocations for instance a5866afe-e285-4ea3-9f02-19530c3290a4
May 14 03:54:30.249844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-3478bdb1-32fd-4333-90b9-071e9bad67bf req-5b86f2de-f98a-4412-93d2-4c36e5e3b066 service nova] Releasing lock "refresh_cache-bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" {{(pid=97948) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 03:54:30.290043 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:30.777608 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:30.778129 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:30.963849 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-b7730b1b-0e15-4e5f-bca3-521d41c98124 tempest-VolumesBackupsTest-728151775 tempest-VolumesBackupsTest-728151775-project-member] Lock "a5866afe-e285-4ea3-9f02-19530c3290a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.040s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:32.783194 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:32.783735 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:32.783735 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:34.180037 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:35.296750 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:35.783217 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:35.783601 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:37.783189 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:37.783548 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:54:37.783548 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:38.518295 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:39.181506 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:39.775321 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.000450650999937352 future=<Future at 0x79d0b044d9d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:39.775321 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:54:39.775519 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] Emitting event <LifecycleEvent: 1778730864.7744892, a5866afe-e285-4ea3-9f02-19530c3290a4 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:54:39.775657 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] VM Stopped (Lifecycle Event)
May 14 03:54:39.783151 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:40.279091 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-c88e7051-e15f-4b63-81ba-1ee8cff4ebf3 tempest-TestVolumeBootPatternV346-1499777380 tempest-TestVolumeBootPatternV346-1499777380-project-member] [instance: a5866afe-e285-4ea3-9f02-19530c3290a4] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:54:40.291768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:40.291768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:40.291768 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:40.291768 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:54:40.306692 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:41.322129 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:41.410975 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:41.411464 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:41.522581 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:41.526698 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:54:41.527788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:54:41.580992 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:54:41.581390 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=13779MB free_disk=72.64161682128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:54:41.581561 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:54:41.581844 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:54:42.637744 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97948) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 03:54:42.638057 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:54:42.638157 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:54:41 up 46 min,  2 users,  load average: 2.37, 4.01, 4.38\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_e2107e69e4f24f49ad24e398462243ac': '1', 'io_workload': '0'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:54:42.730656 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:54:42.730871 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:54:43.233266 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:54:43.739602 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:54:43.739942 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.158s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:54:43.740049 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:44.182622 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:44.740186 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:44.740561 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:44.741762 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:54:44.741762 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.04 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:54:45.307893 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:45.362779 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:49.184888 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:50.320242 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:54.197368 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:55.336272 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:54:59.211627 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:00.350226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:04.225563 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:05.370211 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:05.862820 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:05.862983 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:06.366006 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:55:07.370811 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:08.433819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:08.433819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:08.433819 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Attaching volume ca67a605-6839-4d16-a5e0-1f1b665cbf1b to /dev/vdb
May 14 03:55:08.474930 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.36', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000741', 'execute': None}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:55:08.485313 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.scaleio [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97948) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 03:55:08.512392 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Running cmd (subprocess): nvme version {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:55:08.563885 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] 'nvme version' failed. Not Retrying. {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 03:55:08.564176 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.nvmeof [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] nvme not present on system {{(pid=97948) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 03:55:08.576517 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97948) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 03:55:08.577394 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.lightos [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.36', 'fe80::f816:3eff:fe96:6b73', '192.168.40.6', 'fe80::f816:3eff:feb1:bf4a', '192.168.50.6', 'fe80::f816:3eff:fe36:842f', '192.168.10.6', 'fe80::f816:3eff:feea:d13a', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6809:ff:fefd:f44c', 'fe80::fc16:3eff:feef:5b74', 'fe80::7807:b4ff:fe9e:6e63'] 
May 14 03:55:08.577511 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 03:55:08.577614 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.lightos [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] LIGHTOS: no hostnqn found. {{(pid=97948) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 03:55:08.577883 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.36', 'host': 'np0000000741', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9e66647dd79', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0c6eb37-7cce-44fb-9b97-77f3585cbbbb', 'nvme_native_multipath': False} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:55:08.578115 np0000000741 nova-compute[97948]: DEBUG nova.virt.block_device [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating existing volume attachment record: e68e216d-8434-4003-9137-fe489f1b50d4 {{(pid=97948) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 03:55:09.125933 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Calling os-brick to attach iSCSI Volume {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 03:55:09.126301 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:55:09.126471 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:55:09.126963 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:55:09.127202 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 03:55:09.138171 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:55:09.138829 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:55:09.139452 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:55:09.139726 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:55:09.140124 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:55:09.140309 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:55:09.149964 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:55:09.149964 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:09.153993 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 03:55:09.153993 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:09.161329 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b] added
May 14 03:55:09.161329 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:55:09.161329 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:55:09.161329 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:55:09.161329 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:55:09.161329 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:55:09.161329 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:09.161568 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:55:09.161665 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:55:09.161813 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:55:09.166875 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b] added
May 14 03:55:09.166875 np0000000741 nova-compute[97948]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 03:55:09.166875 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:55:09.166875 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:55:09.166875 np0000000741 nova-compute[97948]: iscsiadm: Config file line 363 does not have value
May 14 03:55:09.166875 np0000000741 nova-compute[97948]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 03:55:09.166875 np0000000741 nova-compute[97948]:  {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:09.167706 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97948) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 03:55:09.167706 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 03:55:09.167706 np0000000741 nova-compute[97948]: DEBUG os_brick.utils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97948) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 03:55:09.236222 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:10.162265 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 03:55:10.168077 np0000000741 nova-compute[97948]: INFO os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.50.100
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:55:10.173710 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:55:10.173710 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.name = iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.tpgt = -1
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.startup = manual
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.leading_login = No
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.iscsi_ifacename = default
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.net_ifacename = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.ipaddress = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.prefix_len = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.hwaddress = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.transport_name = tcp
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.initiatorname = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.vlan_id = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.vlan_priority = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.vlan_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.iface_num = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.mtu = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.port = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.bootproto = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.subnet_mask = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.gateway = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_alt_client_id = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_dns = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_learn_iqn = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_req_vendor_id_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_vendor_id = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.dhcp_slp_da = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.fragmentation = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.gratuitous_arp = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.incoming_forwarding = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tos_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tos = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.ttl = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.delayed_ack = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tcp_nagle = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tcp_wsf_state = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tcp_wsf = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tcp_timer_scale = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.tcp_timestamp = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.redirect = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.def_task_mgmt_timeout = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.header_digest = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.data_digest = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.immediate_data = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.initial_r2t = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.data_seq_inorder = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.data_pdu_inorder = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.erl = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.max_receive_data_len = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.first_burst_len = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.max_outstanding_r2t = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.max_burst_len = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.chap_auth = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.bidi_chap = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.strict_login_compliance = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.discovery_auth = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: iface.discovery_logout = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.discovery_address = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.discovery_port = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.discovery_type = fw
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.initial_cmdsn = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.initial_login_retry_max = 8
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.xmit_thread_priority = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.cmds_max = 128
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.queue_depth = 32
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.nr_sessions = 1
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.authmethod = None
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.username = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.password = ***
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.username_in = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.password_in = <empty>
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.auth.chap_algs = SHA256
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.timeo.replacement_timeout = 120
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.err_timeo.abort_timeout = 15
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.err_timeo.lu_reset_timeout = 30
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.err_timeo.host_reset_timeout = 60
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.FastAbort = Yes
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.InitialR2T = No
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.ImmediateData = Yes
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.FirstBurstLength = 262144
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxBurstLength = 16776192
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Retain = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.DefaultTime2Wait = 2
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxConnections = 1
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.iscsi.ERL = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.scan = auto
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.session.reopen_max = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].address = 192.168.40.100
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].port = 3260
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].startup = manual
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].tcp.window_size = 524288
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].tcp.type_of_service = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].timeo.logout_timeout = 15
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].timeo.login_timeout = 15
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].timeo.auth_timeout = 45
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_interval = 5
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].timeo.noop_out_timeout = 5
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.HeaderDigest = None
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.DataDigest = None
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.IFMarker = No
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: node.conn[0].iscsi.OFMarker = No
May 14 03:55:10.180128 np0000000741 nova-compute[97948]: # END RECORD
May 14 03:55:10.180128 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.185617 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.191382 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.198345 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.198345 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:55:10.198514 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.198514 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:55:10.202796 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.202796 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:55:10.202945 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.202945 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:55:10.230868 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.40.100,3260]
May 14 03:55:10.230868 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.40.100,3260] successful.
May 14 03:55:10.230868 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.241553 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:10.252717 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.252717 np0000000741 nova-compute[97948]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:10.252717 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:55:10.252973 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:10.252973 np0000000741 nova-compute[97948]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:10.252973 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:55:10.253071 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:55:10.253170 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.40.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:55:10.253678 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:55:10.253795 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:55:10.265597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:55:10.265597 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:55:10.387199 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:11.231623 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.50.100,3260]
May 14 03:55:11.231623 np0000000741 nova-compute[97948]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.50.100,3260] successful.
May 14 03:55:11.231623 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:11.242194 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:11.254540 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:11.254540 np0000000741 nova-compute[97948]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:11.254540 np0000000741 nova-compute[97948]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:11.254540 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:55:11.254718 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:11.254718 np0000000741 nova-compute[97948]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:11.254718 np0000000741 nova-compute[97948]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:11.254718 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:55:11.254921 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.116s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:55:11.255014 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to 192.168.50.100:3260 {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 03:55:11.255504 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] HCTL ('9', '-', '-', 0) found on session 226 with lun 0 {{(pid=97948) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 03:55:11.255616 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97948) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 03:55:11.267387 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 226 and hctl ['9', '*', '*', 0] yield: None {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:55:12.268010 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Searching for a device in session 226 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97948) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 03:55:12.268439 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97948) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 03:55:13.175927 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799233 for multipath device dm-0 {{(pid=97948) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 03:55:13.176588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.049s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:55:13.176588 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== connect_volume: return (4049ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799233', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799233'} {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:55:13.176588 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799233', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799233'} {{(pid=97948) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 03:55:13.179910 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:55:13.683417 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Attempting to attach volume ca67a605-6839-4d16-a5e0-1f1b665cbf1b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97948) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 03:55:13.685322 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] attach device xml: <disk type="block" device="disk">
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <alias name="ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b"/>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <serial>ca67a605-6839-4d16-a5e0-1f1b665cbf1b</serial>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]: </disk>
May 14 03:55:13.685322 np0000000741 nova-compute[97948]:  {{(pid=97948) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 03:55:14.058471 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:15.335143 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:55:15.335500 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:55:15.335500 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No BDM found with device name hda, not building metadata. {{(pid=97948) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 03:55:15.335500 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] No VIF found with MAC fa:16:3e:ef:5b:74, not building metadata {{(pid=97948) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 03:55:15.403894 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:16.883199 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-068d5204-f73b-4292-85b2-699ef7108872 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.449s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:17.323213 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:17.323407 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:17.825792 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Detaching volume ca67a605-6839-4d16-a5e0-1f1b665cbf1b
May 14 03:55:17.871048 np0000000741 nova-compute[97948]: INFO nova.virt.block_device [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Attempting to driver detach volume ca67a605-6839-4d16-a5e0-1f1b665cbf1b from mountpoint /dev/vdb
May 14 03:55:17.875939 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:55:17.877397 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Found disk vdb by alias ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b {{(pid=97948) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 03:55:17.877538 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Attempting to detach device vdb from instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 from the persistent domain config. {{(pid=97948) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 03:55:17.877809 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <alias name="ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b"/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <serial>ca67a605-6839-4d16-a5e0-1f1b665cbf1b</serial>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]: </disk>
May 14 03:55:17.877809 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:55:17.883455 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 from the persistent domain config.
May 14 03:55:17.883848 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] (1/8): Attempting to detach device vdb with device alias ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b from instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 from the live domain config. {{(pid=97948) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 03:55:17.883848 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.guest [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] detach device xml: <disk type="block" device="disk">
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <alias name="ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b"/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <source dev="/dev/dm-0"/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <target dev="vdb" bus="virtio"/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <serial>ca67a605-6839-4d16-a5e0-1f1b665cbf1b</serial>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <shareable/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]: </disk>
May 14 03:55:17.883848 np0000000741 nova-compute[97948]:  {{(pid=97948) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 03:55:18.408226 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Received event <DeviceRemovedEvent: 1778730918.4078803, bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 => ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b> from libvirt while the driver is waiting for it; dispatched. {{(pid=97948) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 03:55:18.409495 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ca67a605-6839-4d16-a5e0-1f1b665cbf1b for instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 03:55:18.411859 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully detached device vdb from instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 from the live domain config.
May 14 03:55:18.438297 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] calling os-brick to detach iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 03:55:18.438566 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x79d0b81a2a50>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 03:55:18.438701 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 03:55:18.439000 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 03:55:18.439245 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 03:55:18.439383 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', 0)] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 03:55:18.481983 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:18.481983 np0000000741 nova-compute[97948]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:18.481983 np0000000741 nova-compute[97948]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:18.481983 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 03:55:18.482317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:18.482317 np0000000741 nova-compute[97948]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b (non-flash)
May 14 03:55:18.482317 np0000000741 nova-compute[97948]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3 (non-flash)
May 14 03:55:18.482317 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 03:55:18.482317 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ed692f5-556c-481a-926b-2c68910e54f3', '227')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 03:55:18.482523 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', '225')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:55:18.483224 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b', '226')] {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 03:55:18.484381 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x79d0b859c720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'): ({'sdd'}, set())}) {{(pid=97948) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 03:55:18.484624 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Removing multipathed devices sdd, sdb {{(pid=97948) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 03:55:18.484922 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Flush multipath device 33000000014716a37 {{(pid=97948) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 03:55:18.525427 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:55:18.577047 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97948) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 03:55:18.611187 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if SCSI volumes sdd, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 03:55:18.611384 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] SCSI volumes sdd, sdb have been removed. {{(pid=97948) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 03:55:18.612053 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Checking to see if device paths {'sdd', 'sdb'} are still under multipathd monitoring {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 03:55:18.622420 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.linuxscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Device paths {'sdd', 'sdb'} have been removed from multipathd monitoring. {{(pid=97948) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 03:55:18.622620 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b')] {{(pid=97948) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 03:55:18.634136 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.663817 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.40.100,3260]
May 14 03:55:18.663817 np0000000741 nova-compute[97948]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.40.100,3260] successful.
May 14 03:55:18.663817 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.676463 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.688713 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.714574 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.50.100,3260]
May 14 03:55:18.714574 np0000000741 nova-compute[97948]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-ca67a605-6839-4d16-a5e0-1f1b665cbf1b, portal: 192.168.50.100,3260] successful.
May 14 03:55:18.714574 np0000000741 nova-compute[97948]:  stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.725141 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97948) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 03:55:18.725388 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.base [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 03:55:18.725524 np0000000741 nova-compute[97948]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] <== disconnect_volume: return (286ms) None {{(pid=97948) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 03:55:18.725682 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Disconnected iSCSI Volume {{(pid=97948) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 03:55:19.274013 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'flavor' on Instance uuid bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:55:20.278947 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-6ae631ed-4ba4-4a4e-851f-2d0ff535de83 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.955s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:20.409304 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:20.409476 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:20.409561 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:55:20.409605 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:20.421699 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:20.421839 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:21.662122 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:21.662700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:21.662700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:21.662700 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:21.662863 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:21.664885 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Terminating instance
May 14 03:55:22.167699 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Start destroying the instance on the hypervisor. {{(pid=97948) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 03:55:22.181581 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.184372 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.197803 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.205000 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.219869 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.226367 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.298478 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:55:22.298677 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:22.298819 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:22.298933 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:22.299037 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] No waiting events found dispatching network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:55:22.299154 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-c1fccbea-5a19-4961-b649-c1e8f5e938eb req-476cc30b-816c-495e-9738-803dc9bbe23f service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:55:22.451529 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.456599 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.480175 np0000000741 nova-compute[97948]: DEBUG nova.utils [None req-9e01d025-c3f7-4ecb-adc0-28becc983054 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999713221000093 future=<Future at 0x79d0907333e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:55:22.481038 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.999077899999975 future=<Future at 0x79d0907333e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:55:22.481038 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=14.998831094999787 future=<Future at 0x79d0907333e0 state=pending>) {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:55:22.482389 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Instance destroyed successfully.
May 14 03:55:22.482835 np0000000741 nova-compute[97948]: DEBUG nova.objects.instance [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lazy-loading 'resources' on Instance uuid bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 {{(pid=97948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 03:55:22.984959 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.vif [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T03:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2049535446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000741',hostname='tempest-volumemultiattachtests-server-2049535446',id=81,image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTs0wpn8F4YskRGnQ1yZGYi5+1H+GLSOEVLzVDLFinl1yF/Oh3evzYjQxXa+or8dqpUEktjqVKdKLl5gRU36/KOVxNRK8khp1Z88PZrpK7fHALcfAf4/8h7VqYWtVhVEQ==',key_name='tempest-keypair-1020383361',keypairs=<?>,launch_index=0,launched_at=2026-05-14T03:54:26Z,launched_on='np0000000741',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000741',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2107e69e4f24f49ad24e398462243ac',ramdisk_id='',reservation_id='r-h6mnzn29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6612e57f-dc02-432a-8f21-51e588d0e5b8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1122220317',owner_user_name='tempest-VolumeMultiattachTests-1122220317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T03:54:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27cad4e205374f8b8879c440af287684',uuid=bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 03:55:22.985433 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converting VIF {"id": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "address": "fa:16:3e:ef:5b:74", "network": {"id": "4f337529-cce2-4e8a-a559-5d2578c9827a", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1634738633-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2107e69e4f24f49ad24e398462243ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e45278e-91", "ovs_interfaceid": "6e45278e-9190-40f1-94ca-7bbb1649bd84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 03:55:22.985774 np0000000741 nova-compute[97948]: DEBUG nova.network.os_vif_util [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91') {{(pid=97948) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 03:55:22.985982 np0000000741 nova-compute[97948]: DEBUG os_vif [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91') {{(pid=97948) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 03:55:22.987256 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.987572 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e45278e-91, bridge=br-int, if_exists=True) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:55:22.997736 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.998836 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:22.999324 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:22.999481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558b68fb-4371-4510-9c13-2a5fa5ec7807) {{(pid=97948) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 03:55:22.999903 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:23.000649 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:23.002269 np0000000741 nova-compute[97948]: INFO os_vif [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5b:74,bridge_name='br-int',has_traffic_filtering=True,id=6e45278e-9190-40f1-94ca-7bbb1649bd84,network=Network(4f337529-cce2-4e8a-a559-5d2578c9827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e45278e-91')
May 14 03:55:23.002548 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Deleting instance files /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5_del
May 14 03:55:23.003537 np0000000741 nova-compute[97948]: INFO nova.virt.libvirt.driver [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Deletion of /opt/stack/data/nova/instances/bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5_del complete
May 14 03:55:23.509060 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Took 1.34 seconds to destroy the instance on the hypervisor.
May 14 03:55:23.510191 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._common.loopingcall [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97948) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 03:55:23.510376 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Deallocating network for instance {{(pid=97948) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 03:55:23.510494 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] deallocate_for_instance() {{(pid=97948) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 03:55:23.510774 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:55:23.601779 np0000000741 nova-compute[97948]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 03:55:23.975828 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-077ed882-ad15-46eb-b85c-a82a22350821 req-cb8ffb22-4a8d-4134-bd96-e555722dd77e service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-deleted-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:55:23.975974 np0000000741 nova-compute[97948]: INFO nova.compute.manager [req-077ed882-ad15-46eb-b85c-a82a22350821 req-cb8ffb22-4a8d-4134-bd96-e555722dd77e service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Neutron deleted interface 6e45278e-9190-40f1-94ca-7bbb1649bd84; detaching it from the instance and deleting it from the info cache
May 14 03:55:23.976244 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [req-077ed882-ad15-46eb-b85c-a82a22350821 req-cb8ffb22-4a8d-4134-bd96-e555722dd77e service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:55:24.349041 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 03:55:24.349469 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] Acquiring lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:24.349624 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:24.349788 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:24.349957 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] No waiting events found dispatching network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 {{(pid=97948) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 03:55:24.350096 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-8a2f4702-67ee-4908-a72f-172614fade8f req-bc4949e0-c9d6-488e-8d67-dc52bc665a09 service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Received event network-vif-unplugged-6e45278e-9190-40f1-94ca-7bbb1649bd84 for instance with task_state deleting. {{(pid=97948) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 03:55:24.432513 np0000000741 nova-compute[97948]: DEBUG nova.network.neutron [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Updating instance_info_cache with network_info: [] {{(pid=97948) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 03:55:24.479025 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [req-077ed882-ad15-46eb-b85c-a82a22350821 req-cb8ffb22-4a8d-4134-bd96-e555722dd77e service nova] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Detach interface failed, port_id=6e45278e-9190-40f1-94ca-7bbb1649bd84, reason: Instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 could not be found. {{(pid=97948) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 03:55:24.934553 np0000000741 nova-compute[97948]: INFO nova.compute.manager [-] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Took 1.42 seconds to deallocate network for instance.
May 14 03:55:25.439679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:25.439679 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:25.521957 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:55:25.522151 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:55:26.024827 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:55:26.532133 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.092s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:26.584837 np0000000741 nova-compute[97948]: INFO nova.scheduler.client.report [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Deleted allocations for instance bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5
May 14 03:55:27.595188 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-38ae3032-140e-42ac-b7b4-4ffecc7fc787 tempest-VolumeMultiattachTests-1122220317 tempest-VolumeMultiattachTests-1122220317-project-member] Lock "bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.933s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:28.007226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:28.007226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:28.007226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:55:28.007226 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:28.007548 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:28.007604 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:29.886675 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:30.783553 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:30.783694 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 03:55:31.285490 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] There are 0 instances to clean {{(pid=97948) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 03:55:31.286026 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:31.463184 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:33.008210 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:34.285523 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:34.285950 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:34.285950 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:35.783064 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:35.783504 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:37.480293 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x79d0c1756c60>>, remaining_delay=-0.00038873699986652355 future=<Future at 0x79d0907333e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x79d0c18ae360> {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:55:37.481561 np0000000741 nova-compute[97948]: DEBUG nova.virt.driver [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] Emitting event <LifecycleEvent: 1778730922.4797852, bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5 => Stopped> {{(pid=97948) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 03:55:37.481561 np0000000741 nova-compute[97948]: INFO nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] VM Stopped (Lifecycle Event)
May 14 03:55:37.482436 np0000000741 nova-compute[97948]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97948) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 03:55:37.783182 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:37.783182 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:55:37.783461 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:37.983782 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-faaaeae7-0bab-4a6d-8e64-d8a2424bc273 tempest-ServersNegativeTestJSON-1531732290 tempest-ServersNegativeTestJSON-1531732290-project-member] [instance: bc4c9bf6-6460-43fc-a4a4-0bfb35a078f5] Checking state {{(pid=97948) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 03:55:38.010668 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:38.010850 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:38.010927 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:55:38.010988 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:38.021763 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:38.021928 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:40.783142 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:40.783481 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:41.287473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:41.287621 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:41.287799 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:41.287920 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:55:41.300812 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:55:41.301782 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:55:41.347935 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:55:41.348693 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=14232MB free_disk=72.64709091186523GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:55:41.348693 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:55:41.348902 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:55:42.394322 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:55:42.394632 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:55:41 up 47 min,  2 users,  load average: 2.07, 3.66, 4.23\n'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:55:42.433331 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:55:42.433523 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:55:42.936159 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:55:43.027414 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:43.027847 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:43.027930 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:55:43.028053 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:43.028475 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:43.028713 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:43.443667 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:55:43.444314 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.095s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:55:43.444314 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:43.444314 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97948) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 03:55:43.946232 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:44.448282 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:46.442171 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:46.442591 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:55:46.442591 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.33 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:55:48.029333 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:48.379011 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:53.037116 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:58.038959 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:58.039435 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:55:58.039435 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:55:58.039435 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:55:58.044296 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:55:58.044446 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:03.049658 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:03.050084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:03.050084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:03.050084 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:03.062589 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:03.062737 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:08.067984 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:08.068432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:08.068432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:08.068432 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:08.076061 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:08.076277 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:13.078250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:13.078250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:13.078250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:13.078250 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:13.089415 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:13.089591 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:18.094901 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:18.095290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:18.095290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:18.095290 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:18.096915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:18.096915 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:23.104361 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:28.109115 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:28.109631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:28.109631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:28.109631 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:28.112342 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:28.112481 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:32.777082 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:32.777532 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:33.114127 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:35.783097 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:35.783400 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:35.783483 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:35.783748 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:38.115093 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:38.520372 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:38.783234 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:38.783377 np0000000741 nova-compute[97948]: DEBUG nova.compute.manager [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97948) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 03:56:38.783482 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:40.783126 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:41.287295 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:56:41.287417 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:56:41.287593 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:56:41.287593 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Auditing locally available compute resources for np0000000741 (node: np0000000741) {{(pid=97948) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 03:56:41.299922 np0000000741 nova-compute[97948]: WARNING nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 03:56:41.301569 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 03:56:41.354473 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.processutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=97948) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 03:56:41.354963 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Hypervisor/Node resource view: name=np0000000741 free_ram=14546MB free_disk=72.64552688598633GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97948) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 03:56:41.355187 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 03:56:41.355545 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 03:56:42.544456 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 03:56:42.544937 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Final resource view: name=np0000000741 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:56:41 up 48 min,  1 user,  load average: 0.79, 3.01, 3.97\n'} {{(pid=97948) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 03:56:42.590056 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Refreshing inventories for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 03:56:42.627801 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Updating ProviderTree inventory for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 03:56:42.627967 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Updating inventory in ProviderTree for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 03:56:42.662384 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Refreshing aggregate associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, aggregates: None {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 03:56:42.708948 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Refreshing trait associations for resource provider 2bd2dd56-bccc-4319-9878-49768bc97c10, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_MIPSEL,COMPUTE_NODE,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_AARCH64,COMPUTE_ARCH_RISCV64 {{(pid=97948) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 03:56:42.749118 np0000000741 nova-compute[97948]: DEBUG nova.virt.libvirt.driver [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97948) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 03:56:42.749410 np0000000741 nova-compute[97948]: DEBUG nova.compute.provider_tree [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed in ProviderTree for provider: 2bd2dd56-bccc-4319-9878-49768bc97c10 {{(pid=97948) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 03:56:43.117104 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:43.252479 np0000000741 nova-compute[97948]: DEBUG nova.scheduler.client.report [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Inventory has not changed for provider 2bd2dd56-bccc-4319-9878-49768bc97c10 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97948) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 03:56:43.758665 np0000000741 nova-compute[97948]: DEBUG nova.compute.resource_tracker [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Compute_service record updated for np0000000741:np0000000741 {{(pid=97948) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 03:56:43.759146 np0000000741 nova-compute[97948]: DEBUG oslo_concurrency.lockutils [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.403s {{(pid=97948) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 03:56:43.759196 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:45.753155 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:45.753575 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:45.753790 np0000000741 nova-compute[97948]: DEBUG oslo_service.periodic_task [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97948) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 03:56:45.754098 np0000000741 nova-compute[97948]: DEBUG oslo.service.backend._threading.loopingcall [None req-1f70a28b-62db-4f70-b777-c15514b26548 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.03 seconds {{(pid=97948) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 03:56:48.122734 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:48.123175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:56:48.123175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:56:48.123175 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:48.130906 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:48.131136 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:56:53.131347 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:56:58.132908 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:57:03.134174 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:57:08.135428 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:57:13.137181 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:57:18.139596 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:57:18.140108 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 03:57:18.140108 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=97948) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 03:57:18.140108 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 03:57:18.145559 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=97948) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 03:57:18.145720 np0000000741 nova-compute[97948]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97948) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}